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FIRST YEAR ALGEBRA SCALES 



I 
INTRODUCTION 

The application of scientific measurement to schoolroom products 
has created a demand for objective standards. Indeed, progress 
in the evaluation of educational results is at present largely con- 
ditioned upon the successful establishment of reliable standards 
and units for measurement, and it may also be added that nowhere 
are these instruments of measurement more badly needed than in 
the field of secondary education. 

The purpose of this study is to derive a series of scales for the I 
measurement of achievement in first year algebra. The 'number of j 
times correctly solved* is used as the basis for the statistical cal- 
culations in the development of these scales, and the method em- 
ployed coincides most closely with that used by Doctor Trabue ^ 
in his Completion-Test Language Scales and by Doctor Woody ^ in 
his Measurements of Some Achievements in Arithmetic, 

In designing these scales the writer felt that the main business j 
of the work in first year algebra was to teach students how to solve 
the typical algebra problems through the use of simple algebraic 
symbols and devices. This makes the equation, the formula, the 
graph, and to a lesser degree the proportion, the important instru- 
ments to be used in algebra. Hence, in the construction of these 
scales the major emphasis was placed upon these phases of quanti- 
tative thinking. For the work in the fundamentals, scales in addi- 
tion and subtraction and in multiplication and division were 
devised. 

Each scale includes only such exercises or problems as are quite 1 
universally taught in a course in first year algebra. An attempt * 
was also made to include as large a variety of exercises as could 
possibly be included, and the writer firmly believes that no essential 
algebraic process has been ignored. As usual in scale construction, 

> Trabue, Marion Rex: Completion-Test Language Scales^ 1916. 

* Woody, Clifford: Measurements of Some Achievements in Arithmetic, 1916. 
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the* Exercises begirt •^ith Very easy ones, which can readily be solved 
by nearly all students, but become increasingly more difficult so 
that the last ones in each series can be solved by only a relatively 
small number of the students who try them. 

Numerous attempts to develop standards in algebra have already 
been made. Professor Thorndike * started the work in 1914. He 
selected a list of twenty-five problems and then had two hundred 
teachers of mathematics rate them in order of difficulty. Since then 
standard tests in algebra have been devised by Doctor Rugg,* by W. 
S. Monroe,* by H. G. Childs,* and by C. E. Stromquist.^ A Scale 
for Testing Ability in Algebra has also been constructed by W. H. 
Coleman.* 

* Thorndike, E. L.: "An Experiment in Grading Problems in Algebra* in Mathematics 

Teacher, 6:133, I9i4- 

* Rugg, H. O.: "Standardized Tests in First Year Algebra* in School Review, 35:113, 

196, 346, 1917. 
•Monroe, W. S.: "A Test of Attainment of First Year High School Students in 
Algebra* in School Review, 33:159, 191 5. 

* Childs, H. G.: "Measurement of Achievement in Algebra"; in Third Conference on 

Educational Measurement, in Bulletin of Extension Division, Indiana University, 

1916, vol. II, no. 6, p. 171. 
^University of Wyoming, Laramie, Wyoming. 
'Superintendent of Schools, Bertrand, Nebraska. 



II 

ORIGIN AND USE OF THE FIRST 
YEAR ALGEBRA SCALES 

I. HISTORY OF THEIR DERIVATION 

The preliminary work on the scales, as shown in their final 
form on the next few pages, was begun in the fall of 1916. The 
first set was drawn up in accordance with the principles previously 
announced and included tests in: 

1. Addition and Subtraction 

2. Multiplication and Division 

3. Equation and Formula 

4. Problems 

5. Graphs 

These tests were given during the months of December, January, 
and February in various high schools of New York, New Jersey, 
and Connecticut. In all, 3,605 test papers were secured for this 
preliminary series. These were distributed as follows: The addition 
and subtraction test was given to 829 students, the multiplication 
and division test to 818 students, the equation and formula test to 
800 students, the problem test to 895 students, and the graph test 
to 263 students. 

From the results of this preliminary work it was evident that 
many of the exercises selected were useless, or, at best, of doubtful 
value as test material; some of them were not clearly stated, others 
ran very unevenly as seen by the fact that they were often solved 
more frequently by classes having little training in algebra than 
by more mature classes, and still others tended to group them- 
selves too much about the same point upon a scale of relative 
difficulty. It was, therefore, necessary to discard many of the 
original exercises. Those remaining were then arranged in 
order of difficulty, as determined by the preliminary results, 
and wherever large gaps appeared between two successive exercises 
an attempt was made to interpose new ones. In these final re- 
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visions, as well as in the original construction of the tests, only those 
exercises and problems most commonly found in the recent text- 
books were included. In the selection of all material due consid- 
eration was also given to suggestions of competent teachers and 
specialists in mathematics. 

The revised tests were given during the months of April, May, 
and June, 1917. They were given to students who had studied 
algebra all the way from two to ten months. Practically all of 
those tested wer^ in the ninth grade or the so-called first year of 
the high school. 

Classes were tested in eighty-four high schools located in the 
states of Massachusetts, Connecticut, Rhode Island, New York, 
New Jersey, Ohio, Wisconsin, Missouri, Oklahoma, Colorado, and 
Washington. These schools varied in size all the way from the 
small rural high school to the large cosmopolitan high school. The 
addition and subtraction exercises were given to 3,186 students, 
the multiplication and division exercises to 3,065 students, the 
equation and formula exercises to 3,047 students, the problem set 
to 2,670 students, and the graphs to 1,137 students. 

By far the greater number of the tests were given by the writer 
himself.^ The method adopted in administering the tests is given 
in detail in the following section. In order to be absolutely certain 
that the exact difficulty of each exercise or problem be accurately 
determined, it would have been desirable to allow each pupil all 
the time he wished to use on each test. This was, however, not 
always possible on account of the rigid daily schedule upon which 
many schools were operating, and it was often necessary to call 
time at the end of forty or forty-five minutes. Evidence collected 
by a system of checks, however, seems to indicate that the time 
allotment was ample ^ and that the results were not materially 
affected by such limitation. 

1 Nearly all of those given in the East were given by the writer. Those given in the 
West and Middle West were given by men who were known personally and who 
could be trusted to follow instructions faithfully. 

* In ninety-six out of two hundred of the tests submitted to nine months' students, 
exercises No'. 19 and No. 25 in the equation and formula test were interchanged. 
They were then submitted to classes on a 'fifty-fifty' basis. The results showed that 
exercise No. 35 was solved correctly about three times as often when it came last 
in the list, while No. 19, on the other hand, was solved more frequently when it 
came nineteenth on the list. Similar checks were employed in each of the other 
tests, with the exception of the graph test, and similar results were obtained. 



Origin and Use 

SERIES A 
FIRST YEAR ALGEBRA SCALES* 

Write your name here Age 

When did you begin to study algebra? Month Year. . . 



ADDITION AND SUBTRACTION 



Carefully perform the operations cis indicated. 



(2) I. 4r + 3r + 2r = 3. 12b + 66 - 36 = 



(7) 5. 7x-x + 6-4= (8) 9. (4f - 5/) + (5 - 3r) = 



10. 8c - ( - 6 + 3c) = 12. 53c - [4x - (33c - i)] = 



13.-^-^= (.7)15. ' ^* 



8 a — ac a^ — x^ 



(15) 18. 3 - ^ 2x= 22. -^ + ^ 



{x-iy (jc-i)2 {x-i) 



(24) 23. \/20 + V45 + V -i- = (23) 24. — ^ ""^477+ ^^ 



a — 2 a + 2 4 — a' 



*These scales are printed separately on large sheets S^'^x 11''. Sufficient space is 
left between the exercises so the pupils can work directly upon these sheets. 

A number appearing in parenthesis before one of the above exercises or problems 
indicates that it occupied a different position in the test series from that now occu- 
pied in the final scales. In the statistical tables of this study the numbering of 
the exercises corresponds to that used in the test series. 
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SERIES A 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age. 

When did you begin to study algebra? Month Year 



MULTIPLICATION AND DIVISION 

Carefully perform the operations 2is indicated. Reduce all answers 
to their simplest forms. 



i2n 
I. 3 • 7y = 2. 



3. 2a • 4a6* = 7. 4^ • ( — 3xy) = 



(8) 9. '- = II. (2a2 + 7a - 9) (set - i) = 

9wn 



16. ( - Zxy'Y = (18) 17. . — • — — - 

(c — dy c* + (P 



(22)20.^ + ^^-^5 P^-^ 



^ + 2/> + 4 ^ - 81 3/>f - I5f 



(20) 21. ^ + ^'^ ^ 3f_+_9 ^ (2j) 22. 64 3 X 27 -^ = 

ac* + X — 12 ac + 4 



3\/6a / 

23. -= • V 12a 

2a V18 



Origin and Use 

SERIES A 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age. 



When did you begin to study algebra? Month Year. 



EQUATION AND FORMULA 
Solve the following equations and formulae: 

I. 2x = 4. (3) 2. 7w = 3w + 12. 

4. 5a + 5 = 61 — 3a. (5) 6. 10 — iiz = 4 — 82. 

(7) 8. c - 2(3 - 4c) = 12. 



(9) II. The area of a triangle = J/^bh, in which 

b = length of the base 
and h = height of the triangle. 

How many square feet are there in the area of a triangle whose 
base is 10 feet, and whose height is 8 feet? 



(16) 14. 3f» + 7n = 34 ^g x + 3 ^ x + 5 

7f» + 8« = 46 ' X — 2 X — 4 



19. ^ - 5/> = 50. (21) 23. : — - 3 - 



X + 3 x2 - 9 



24. S = "T-g/*, solve for /. 25. Vac^ — i — x = — i. 
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SERIES A 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age 

When did you begin to study algebra? Month Year 

PROBLEMS 

Do not work out the answer to the problem — ^merely indicate the 
answer or state the equation in each case. 

I. If one coat cost x dollars, how much will 3 coats cost? 

Answer 

(3) 2. A man is m years old; how old was he r years ago? 

Answer 

4. A gold watch is worth ten times as much as a silver watch, and both 

together are worth $132. How much is each worth? 

Equation 

5. The distance from Chicago to New York by rail is 980 miles. If a 

train runs v miles an hour, what is the time required for the run? 

Answer 

7. The total number of circus tickets sold was 836. The number of tickets 

sold to adults was 136 less than twice the number of children's 
tickets. How many were sold of each? 

Equation 

8. A rectangular box is d inches deep, w inches wide, and contains r 

cubic inches. What is its length? 

Answer 

9. The area of a square is equal to that of a rectangle. The base of the 

rectangle is 12 feet longer and its altitude 4 feet shorter than the 
side of the square. Find the dimensions of both figures. 

Equation 
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12. A train leaves a station and travels at the rate of 40 miles an hour. 
Two hours later a second train leaves the same station and travels 
in the same direction at the rate of 55 miles an hour. Where 
will the second train pass the first? 

Equation 

(14) 13. A merchant has two kinds of tea, one kind costing 50 cents and the 
other 65 cents per pound. How many pounds of each must be 
mixed together to produce a mixture of 20 pounds that shall cost 
60 cents per pound? 

Equation .* 

(13) 14. An open box is made from a square piece of tin by cutting out a 
5 inch square from each corner and turning up the sides. How 
large is the original square, if the box contains 180 cubic inches? 

Equation 
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FIRST YEAR ALGEBRA SCALES 

Write your name here Age. .. 

When did you begin to study algebra? Month Year. . 

GRAPHS 
I. The following diagram represents the length of certain rivers: 



Mississim 

BT.UWSERCI 



ABIUS3AS 

coinaiA 



How many miles long is the Arkansas river as represented in this diagram ?. . 
3, This graph indicates the population of a certain town for a period of years : 
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What was the approximate population of the town in 1856?. , 



Origin and Use 



. This table gives the interest at 6 
per cent on $ioo for a period 
o( years: 





IttUrest 


Years 


in dollars 


J 


6 


2 


12 


3 


I8 


4 


24 


5 


30 


6 


36 



Locate in the adjacent diagram the 
points corresponding to the 
above data. 

Then connect these points by a line. 
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(6) 5. The graph oppo- 
site is used to con- 
vert degrees of tem- 
perature from the 
Fahrenheit scale {F) 
to the Centigrade 
scale (C), and from 
the Centigrade scale 
to the Fahrenheit 
scale. 

When it is +20° on the 
F. scale, what is the 
temperature in degrees 
on the C. scale? 



I>Hr*M OntiflrMa 
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(7) 6. This graph represents the distance passed over by a n 
the rate of 3 miles an hour for a number of hours. 




By the conditions of the problem it may be said thai the number of 
miles travelled equals three times the number of hours, or 



U k =* 2, then m = 6; 

if ft " 4, then m " 12; 

and if A =• 6, then m » 18, etc. 

By locating these points, we have a, b, c, d, etc., of the graph. 
In the same diagram draw a graph in which 
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(9) 7. I^d three pain of values for x and y in the fdlowii^ equation and 
then draw the graph of 

* + y = 5- 



y 

— — — — -y — — — — — ^ — _____ 

y' 



1 Spus« ■ 1 Onib 

10. Plot the following equations and find the values of x and y at the point 
of intersection of the graphs. 

X + 43r = 11. 
M - y = 4. 



7 

7 — — — — -J 

y" 



1 Spaoe - 1 onlt 
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A boy begins work with a weekly w^e of $9 and receives an increase of 
25 cents every week. Another boy starts with a weekly wage o( only 
$6 but receives an increase of 50 cents every week. 



Draw a graph which shows the wage of each at the beginning of every 
week for 15 weeks. 

According to this graph when will their wages be the same? 



Origin and Use 15 

SERIES B 
FIRST YEAR ALGEBRA SCALES 



Write your name here Age. . 

When did you begin to study algebra? Month Year. 



ADDITION AND SUBTRACTION 
Carefully perform the operations as indicated. 
(2) I. 4r + 3r + 2r = (i) 2. 2x + $x ^ 

3. 126 + 66 — 36 = 4. 2C + 'TC ^ 

(7) 5. 7« - «: + 6 - 4 = (5) 6. 3a - 46 + 50 - 26 = 
(6) 7. 5w + ( - 4w) = (9) 8. 20X - (lox + 5«) = 

(8) 9. (4r - 5<) + (5 - 3r) = 10. 8c - ( - 6 + 3c) = 
II. 3a' - 3^ - (2a' + 3^ - 4) == 12. sac - [4x - (3X - i)] 
t^ 3^ 3g ,^ 3y--2 , y + 4 



a — X a' — X* f + 2 r — 2 

/«\ 50+1 3^ — 2 /x« 3 — 2X 
(18) 17. ^^ ^ = (15) 18. 3 — ^ 2X 



19. 



(21) 20. 



(20) 21. 



6a 2a 

lox + 3y 3X + $y 



2x^y xy^ 

I a a — 4 



a + 1 a' — a+i a'+i 

2 15 

x' — 5x + 6 x* + 2x — 15 



,,..lJlii.+ ^ + ^ 



(x - I)» (x - I)« (x - I) 

(24)23. V20 + V45 + v^ = 

(23) 24. ; — + 



a — 2 a + 2 4 — a' 



— /.« 
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SERIES B 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age 

When did you begin to study algebra? Month Year 

MULTIPLICATION AND DIVISION 

Carefully perform the operations as indicated. Reduce all answers 
to their simplest forms. 



3 

5 

7 

(8) 9 



3- 7y = 

2a • 4ab^ =* 

-f- of 9f» = 

4^ • ( - 3xf) = 
i8f»'« — 2ymn^ 



(14) 13. 



15. 



(18) 17. 



9mn 
II. (2a« + 7^-9) iSa - i) = (13) 12. 
7a . ya^ 



15 20 

m + n b 



c^-d^ c-d 



(c - dy c^ + d^ 



2. 


I2n 
4 


4. 


6<:» -s- 2c* = 


6. 


-8a«6 
4a« 


(9) 8. 


fit' • ( - 3fl) • ( - 2a) = 


(12) 10. 


5 


(13) 12. 


«< + 7n2 - 30 
»'- 3 


(10) 14. 


— I2acy ' (x — 2) 


-sxV 


16. 


( - 3^/)* = 


(17) 18. 


X 3 

3« ^ • 4.'^ ^ - 



3 



a2 + i-a - I 
19. - 



(22) 20. 



a + 2 
t^ + AP-^S ^ - 8 



^ + 2/> + 4 p'-Si spr- I5r 



. . 3c* + 27 3^ + 9 

(20) 21. ^ '^— — i— ^= 

X* + X — 12 :x; + 4 

a I 

(21) 22. 64 3 X 27 3 = 



3\/6a / 

23. —^ — 7=. V 12a = 



2a 



\/i8 
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SERIES B 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age 

When did you begin to study algebra? Month Year 

EQUATION AND FORMULA 

Solve the following equations and formulae: 

I. 2x = 4. (3) 2. 7w = 3w + 12. 

(2) 3. 3* + 3 = 9. 4. 5a + 5 = 61 - 3a. 

(6) 5. 7n — 12 — 3« + 4 = o. (5) 6. 10 — iiz = 4 — 82. 

(8) 7. -jz = 6. (7) 8. c - 2(3 - 4c) = 12. 

(10) 9. -TX + TX^S' (11)10. — = 



3 8 

(9) II. The area of a triangle = J^ bh, in which 

b = length of the base 
and h = height of the triangle. 

How many square feet are there in the area of a triangle whose base 
is 10 feet, and whose height is 8 feet? 

(13) 12. -^ = ^^ ^ . (12) 13. f (^ + 5) = 5. 

324 

r.^\rA 3w + 7w = 34 r,A\ .c ^ ^ 

(16) H- ^_ I Q^ _ .A (H) 15- ~ 



7w + 8« = 46 " ^' ^* 3 _ 3C I + 3C 

(15) 16. The area of a circle = Trr^, in which 

f = radius of the circle 
and T = 3-7-. 

Find the area in square feet of circle whose radius in 7 feet. 
(18) 17. In the formula RM = E/, find the value of M, 

f\r.X + %X+$ 

(17) 18. —^-^ -^-^. 19. />2 - 5/> = 50. 

X — 2 X -" 4 
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20. = • (22) 21. 1 = I 

a;' + 4x + 3 3C2 + 3X + 2 X y 

X y 

(23) 22. F = temperature in Fahrenheit degrees 

C = temperature in Centigrade degrees 

andF=:-^+32^ 

5 
Solve for C when F = 70**. 

, V 63c - 2 3x« + 13 

(21) 23. ; 3 = —I 

x + Z x« - 9 

24. 5 = iril^i solve for /. 



25. Vac' — I — «= — I. 



SERIES B 
FIRST YEAR ALGEBRA SCALES 

Write your name here Age 

When did you begin to study algebra? Month Year 

PROBLEMS 

Do not work out the answer to the problem — merely indicate the 
answer or state the equation in each case. 

I. If one coat cost x dollars, how much will 3 coats cost? 

Answer 

(3) 2. A man is m years old; how old was he r years ago? 

Answer 

(2) 3. A boy has a marbles and buys h more; how many has he then? 

Answer 

4. A gold watch is worth ten times as much as a silver watch, and both 
together are worth $132. How much is each worth? 

Equation 
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5. The distance from Chicago to New York by rail is 980 miles. If a 

train runs v miles an hour, what is the time required for the run? 

Answer 

6. The width of a basket ball court is 20 feet less than its length. The 

perimeter of the court (distance around) is 240 feet. Find the 
dimensions. 

Equation 

7. The total number of circus tickets sold was 836. The number of 

tickets sold to adults was 136 less than the number of children's 
tickets. How many were sold of each? 

Equation 

8. A rectangular box is d inches deep, w inches wide, and contains r 

cubic inches. What is its length? 

Answer 

9. The area of a square is equal to that of a rectangle. The base of the 

rectangle is 12 feet longer and its altitude 4 feet shorter than the 
side of the square. Find the dimensions of both figures. 

Equation 

ID. A tower casts a shadow of 20 feet. A man, 5 feet 9 inches high, who 
is near at the same time, casts a shadow of 2 feet 6 inches. Find 
the height of the tower. 

Proportion 

11. Five thousand dollars is invested in two banks, part in one at 3 per 

cent and the rest in the other at 4 per cent. The annual income 
from the two investments is $172. How much is each investment? 

Equation 

12. A train leaves a station and travels at the rate of 40 miles an hour. 

Two hours later a second train leaves the same station and travels 
in the same direction at the rate of 55 miles an hour. Where will 
the second train pass the first? 

Ex^uation 

13. A merchant has two kinds of tea, one kind costing 50 cents and the 

other 65 cents per pound. How many pounds of each must be 
mixed together to produce a mixture of 20 pounds that shall cost 
60 cents per pound? 

Equation 
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14. An open box is made from a square piece of tin by cutting out a 
5 inch square from each corner and turning up the sides. How 
large is the original square, if the box contains 180 cubic inches? 

Equation 




SERIES B 



FIRST YEAR ALGEBRA SCALES 



Write your name here Age. , 

When did you begin to study algebra? Month Year. 



GRAPHS 

I. The following diagram represents the length of certain rivers: 



IUS8ZS8ZVPZ 

ST .LAVRIMCB 
YTXOI 
ARKAI8A8 
OOIAttBU 




IIXUS 



How many miles long is the Arkansas river as represented in this 
diagram? 
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3. The folldwing graph repreEents the temperature at various hours 
of a certain day: 
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How many degrees was it at twelve o'clock?. . 



3. This graph indicates the population of a certain town for a period 
of years: 
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What was the approximate population of the town in 1856?. . 
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4. This table gives the interest at 6 ff^ 
per cent on f 100 for a period of 
years: 





Interest 


Years 


indoUars 




6 




12 




18 




24 




30 




36 



Locate in the adjacent diagram the 
points correBponding to the above 

Then connect these points by a line. 
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(6) 5. Thegraphopposite 
is used to convert de- 
grees of temperature 
from the Fahrenheit 
scale {F) to the Centi- 
grade scale (O, and 
from the Cent^rade 
scale to the Fahrenheit 
scale. 

When it is +20* on the 
F. scale, what is the 
temperature in degrees 
on the C. scale? 



Btcr<«S CantlgrMa 
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(7) 6. This graph represents the distance passed over by a man waikii^ at 
the rate of 3 miles an hour for a number of hours. 



By the condittons of the problem it may be said that the number of 
miles travelled equals three times the number of hours, or 

Thatis- 

if ft — 2, then m — 6; 

if ft - 4, thentn - 12; 

and if ft K 6, then m <= 18, etc 

By locating these points, we have a, b, c, d, etc, of the graph. 



In the same diagram draw a graph in which 



24 Pifst Year Algebra Scales 

(9) 7. Find three pairs of values for x and y in the following equation and 
then draw the graph of 



y 



1 ep«o» ■ 1 Dnit 



(5) 8. The following table gives the number of inches contained in a number 
of feet; 



Feet 


Inches 


J 


12 


2 


24 


3 


36 


4 


48 


5 


60 


6 


72 
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Represent these facts in the diagram at the right. Let distances on 
the horizontal line represent feet, 3 spaces equaling i foot. Let 
vertical distances above that line represent inches, i space equaling 
4 inches. Then locate the points corresponding to the above data 
and connect by a line. 



(8) 9. In the diagram for Exercise No. 6, draw the graph of 
m = 4 + A. 



10. Plot the following equations and find the values of X and y at the 
point of intersection of the graphs. 

* + 4j'=ii, 
2X- y= 4. 
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y 



X gpaoo ■ 1 Unit 

. A boy begins work with a weekly wage of $9 and receives an increase 
of 25 cents every week. Another boy starts with a weekly wage 
of only $6 but receives an increase of 50 cents every week. 

Draw a graph which shows the wage of each at the beginning of 
every week for 15 weeks. 

According to this graph when will their wages be the same? 
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To insure uniformity to the largest possible extent, all the test 
sheets were scored by the writer. The exercises were marked either 
right or wrong according to standards previously determined, and 
more or less arbitrary. These answers are given in a following 
section. 

II. DIRECTIONS FOR GIVING THE T^STS* 

Two series of scales are here submitted — ^Series A and Series B. 
Series A was derived from Series B. It covers just as wide range 
of difficulty; and, because it is shorter, it is recommended for use 
where the time available for testing purposes is limited. Series B 
includes a richer variety of exercises arid problems, thus increasing 
the diagnostic power of the scales, and is recommended for use 
wherever time will permit. If only one of the scales can be used, 
the writer would recommend that the Equation and Formula 
Scale be used because he feels that it is more comprehensive and 
tests a much wider function than any of the other scales. If it is 
desired to use a second scale he would recommend the Problem 
Scale as coming second in order of importance. 

Both series of scales are to be administered in exactly the same 
way, the only difference being in the amount of time allowed for 
each test. 

In order that results with these scales may be obtained which 
are fairly comparable, it is absolutely necessary that the same 
method be pursued in administering the tests as was originally 
employed in the development of the scales. Directions should be 
implicitly obeyed. No conversation of any kind should be permitted 
after a test has once begun, neither by students, teacher, nor person 
in charge of the test. 

While the test sheets are being distributed, ask the students to 
wait for full directions before doing anything at all with the tests. 

When all are ready say to the class, "Now write your name in the 
first blank space. In the next blank space to your right tell how 
old you are. Give this in full years to your nearest birthday," etc. 
After the sheets are properly headed, say to the class, "The exercises 
on this sheet are in addition and subtraction, collection of terms.* 

'See also instructions given in the Appendix, p. 8i. 

* Instead of the phrase 'in addition and subtraction, collection of terms' use 'in multi- 
plication and division', 'on the equation and formula', or 'problems in algebra' 
whichever the case may be. 
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Work directly on these sheets. Take the exercises in the order in 
which they are given. Work as many as you possibly can and be 
sure you get them right. If you come to one you cannot do, leave 
it out and pass on to the next." 

In the Multiplication and Division Scale call attention to the 
fact that "all answers must be reduced to their simplest forms.** 

For the Problem Scale add: "In all the problems which call for 
the equation, e. g., No. 4, simply state the equation which will 
solve the problem. For example, if you were given this problem — 
A coat and hat cost $30. The coat cost five times as much as the 
hat. Find the cost of each. The equation would be x+5x=$30." 
(Then write this equation on the board.) 

For Graph Scale let the pupils use rulers. 

Pupils may be provided with scratch paper for their own use.. 
It has been found to be most satisfactory to pass down the aisles 
and give each pupil a sheet of scratch paper a few minutes after 
the test has begun. They will find it most convenient, however, 
to work directly on the. question sheets. For all but the Problem 
Scale it is desirable to have as much of the work as possible on these 
sheets. 

The time limits to be observed in giving the tests are as follows:* 
for each test in Series A allow twenty minutes, except the Problem 
Scale and the Graph Scale, for each of which twenty-five minutes 
should be allowed ; and for each test in Series B allow forty minutes. 
By far the greater number of the pupils will have finished before that 
time, and those who have not will in all probability have solved 
all they are able to do. A warning, stating the amount of time left, 
should be given three minutes in advance for the tests of Series A 
and five minutes in advance for those of Series B. 

III. INSTRUCTIONS FOR SCORING AND 
TABULATING THE RESULTS 

As Stated before, the exercises or problems were marked either 
right or wrong. The standards adopted in judging the correctness 
of an exercise were necessarily quite arbitrary. They were, never- 

* The limits spedfied above are for classes having studied algebra for a year, or for 
nine months. When the tests are given to classes having studied algebra for a 
shorter period of time, the time allowed for each test should be scaled down accord- 
ingly. 
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theless, determined only after considerable experimentation and 
personal consultation with teachers of mathematics. These stand- 
ards are found in Tables I and II. In order to get results which 
are fairly comparable with those given in this study, it is of course 
absolutely necessary that the papers be scored iir accordance with 
these standards. To insure greater uniformity in scoring, a few 
incorrect answers are also included. Reduction to lowest terms 
was insisted upon only for the test in multiplication and division. 

After the papers of a class were scored the results from each 
class were tabulated upon a separate sheet. A sample of the form* 
as used in this study is given in Fig. i. 

The final value of each exercise or problem for each of the tests 
is given in Table III, and in the graphic representations which 
follow this table the difficulty of each of these exercises is projected 
upon a linear scale. 

* Inasmuch as the writer was required to report back to each principal the number 
of exercises or problems solved by each student, together with the median class 
score, this form was found to be a very convenient source of reference for this pur- 
pose as well. 
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TABLE I 

ANSWERS TO BXBRCISBS 



Problem 
Number 


Addition and 
Subtraction 


MuUiffication 
andvivision 


Equation and 
Formula 


I 


9r 


2iy 


2 


2 


Sx 


3» 


3 


3 


I5b 


8a»6« 


2 


4 


2Hc; f 

2 


3<^ 


7 


5 


6x+2 


6m 


2 


6 


8a -66 


-26 


2; not — »— — 2 


7 


m 


— I2«*y» 


9 


8 


5x 


6a» 


2 


9 


r-5^+s 


2m-3fi 


4 


10 


5C-6 


2a:» 

5 


15 
i6 


II 


a— 66+4 


ioa»+33a«-52a+9 


40 


12 


4JC— I 


n»— 10 


2 30 

S^ 7 


13 


3<: 6c 
8 • i6 


4 
3a 


15 


H 


7x 
6 


4af-8; 4{x-2) 


m«2, «=4* 




a— 2« 


b b 


x/ 


^5 


a(m— «)' am— an 


Yi 


i6 


21* 2f* 


8ix<y« 




r*~i»' (r-») (r+«) 


1 54 


17 


7-4a 
6a 


c+d; not 7 

c— d 




i8 


9— 63C 9 6x 
4 4 4 


4 

I2a:»; I2»' 


nor — x-K 
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TABLE I— (Continued) 



Problem 
Number 



19 



20 



21 



22 



23 



24 



25 



Addition and 
Subtraction 



2X« >>• 



5 -3a 



5-30 



(a+i)(a»-a+i)* a»+i 

(*-3) {«-2) (*+5)' 

40-i3y 
«»-i9x+30 



(x-i)»V-3«'+3*-i 

5;VT; 

not 5V^+ -V^ 
o 

6a— 7 7— 6a 



t»— 



a'— 4 4— a 



— /l2 







a-^; 



2a— I 



^—2 ^—2 



3r(/»-9)* 3/^-27 



«*-3«+9 «*-3i«+9 
3(«-3) ' 3«-9 



48 



Equation and 
Formula 



10, —5 (both roots) 



-5, -i;*not -««5 



af=2*,y- 4 



I 190 
21-; — 

9 9 



[25 /_£_ I 



2£5 






* Where two results are ordinarily required in an answer* the exercise was marked 
correct if the work was done correctly up to the point where only one value was 
obtained and stopped at that. If, however, the student made an error in solving 
for the second value, the problem was scored incorrect. 
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TABLE II 

ANSWERS TO PROBLEM TEST 

1. 3» 

2. m— f 

3- a+b 

4. x+iox = i32. ($12 and $120) 

5. 1^ 

V 

6. 4x4-40=240; 2x+2(x— 2o)=240; 4JC— 40=240. (50 ft.Xyo ft.) 

7. 3« — 136 = 836; 2x — 136 = 836— 3c; X +y = 836 and x = 2^—136. 

(324 children and 512 adults) 

r 

8. -7—; not dwx^t 
aw 

9. (x+12) (x-4) =«*. (6 ft. X6 ft. and 2 ft.Xi8 ft.) 

10. 2>^ : 5><=20 : x; x : 20 = 5 ft. 9 in. : 2 ft. 6 in.; x : 20 = 69 : 30; eight times 

as high as the man; not 2*6 : 5*9 = 20 : x, (46 ft.) 

, J« , 4y 3* , 4(5000 -x) 

11. x+y = 50oo and h — = 172; 1 = 172; 

100 100 100 100 

.03X+200— .04X = 172. ($2800 and $2200) 

X X 

12. 40x = 55(x-2); 55x=4o(x+2); 2= — . (293 >^ miles) 

40 55 

13. x+y=20 and 50x4-65^ = 1200; 50x4-65(20— x) = 1200; not 50x4-65(20— x) 

= 12. (6}i lbs. and i^H lbs.) 

14. 5x' = i8o; 5(x — 10)* = 180. (16 in. X 16 in.) 



The equations given above are those which are usually found. Modifications 

which in the end equal the same, may be accepted. For example, 4X =2404-40 

69 X 

is the same as 4x— 40 = 240, and = is the same as 69 : 30 =x : 20. Where 

30 20 . 

the problem has been worked out and the correct answers are given, they are to 

be scored as correct, though such a procedure on the part of students is to be 

discouraged. 



Origin and Use 
TABLE U—{Cofaintted) 

ANSWERS TO GRAPHS 



Problem 

No. 



3- 3330 to 3350 (inclusive) 
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TABLE ll—(Conlinued) 

ANSWERS TO GRAPHS 



— 3 to — 9 (inclusive) 




problem 

No. 



Origin and Use 
TABLE ll~iQmtinueS) 

AHSVSRS TO GRAPHS 
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TABLE U— (Continued) 

ANSWERS TO GRAPHS 



y-2. 


' 1 


T 


7 


f 
-^ 


^^m 


- — / 


/ 




^ '' 



1 spam ■ 1 Onit 

In twelve weeks; the thirteenth n 



;;:;:';!! :__ 



City.. 
Test.. 



Origin and Use 
School . . 
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Sample Sccwe Sheet Used in Tabulating Results from Each Clasi 
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TABLE III 
Established Value ^ of Each Exercise or Problem in E^ch Scale 



Problem 
Number 


Addition 


MuUipli- 


Equation 






and Sub- 
traction 


cation and 
Division 


and 
Formula 


Problems 


Graphs 

• 


I 


♦1.17 


♦1.45 


♦i.io 


♦1.07 


♦1.41 


2 


1.66 


♦2.29 


♦2.27 


♦2.61 


1.98 


3 


♦2.06 


♦2.92 


2.74 


3.16 


♦2.61 


4 


2.46 


3 26 


*3.I3 


*3.35 


♦3.61 


5 


♦2.97 


3.42 


3.27 


♦4.24 


♦4.46 


6 


3.19 


3.86 


*3.49 


5.09 


♦5.06 


7 


3.30 


♦3.92 


4.13 


*5.09 


*5.79 


8 


3.46 


4.10 


♦4.20 


*5.72 


5.97 


9 


*3.70 


*4.54 


4.38 


♦6.20 


6.32 


10 


♦4.08 


4-93 


4.94 


6.36 


♦6.68 


II 


4.27 


♦5.14 


♦4.96 


6.42 


♦7.72 


12 


*4-55 


5.16 


5.24 


♦6.80 




13 


♦4.92 


5.39 


5.29 


*7.58 




14 


5.39 


5.44 


♦5.56 


♦8.19 




15 


*5.6i 


5.72 


5.60 






i6 


5.74 


♦5.85 


5.99 






17 


6. II 


♦6.60 


6.14 






i8 


♦6.41 


6.73 


♦6.17 






19 


6.42 


6.89 


♦6.79 






20 


6.63 


•6.99 


6.86 






21 


6.70 


•7.44 


7.15 






22 


•6.95 


♦8.80 


7.19 






23 


•7.76 


♦9.32 


•7.58 






24 


♦8.09 




•8.53 






25 






*9.I3 







' Values which are starred (♦) are for the exercises or problems of Series A. 
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A9DXTX0V ant SUBTRACTZOV 

8« yi»» A» » ».»♦»» » »♦ ♦♦ 
J--— -7— -—-5-— 7— —7 J- 4 7 t # 






MULTIPIIOATIOH and DITIBIOV 



1 



s«ri»a A 


* 


* 


* 


* 


* 


♦ ♦ . 


♦ ♦ 


* 




« 4t 


^^ 


1 > 




A 


^ 


-^ 




^' 4 


7 




r 


^ 


/0 


8«ri»* B 


* 


* 


♦ ♦ ♦ 


/ ♦ 


«i 


Ht %♦* ♦* 


m**m 


■* 




* * 




V / 




A 


^ 


:< 




^- 4 


w 

7 




9 


t 


/• 



; » 



EQT7ATI0V and FORICDLA 

8» yi»a A ^ » »»»»»»♦ » »♦ 

i ^"7 JL ^ 7 3= 1 7 ; f 



/• 



♦ ♦♦♦♦*♦ ^. 

Sa riaa B» » ♦»♦» ♦♦ »»♦♦» »»»♦ » ^ 

• i jf, ^ ^ J' Z 7 9 9 /• 



fsoBcan 

Sa yiaa. A» ♦ » » »♦»♦»» 

A > A jr -^' > T ^ t I 

Sa riaa B ♦ ♦ ♦♦ ♦ t ♦ ♦*♦ a a » 



6BAPH8 
Ba yiaa A a ♦ a ♦ » » a a . 

» 7 i 5 ^ 5= J ^ I 

Sa yiae B * * * * «* *««* ♦ 

t ' I ' ■ —^—■—1 I . 1 — ^— >— I ———1 

Figure 2 

Linear Projection of the Difficulty of the Exercises and Problems, 

Series A and Series B 
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IV. DETERMINATION OF CLASS SCORE 

The median class score is recommended for use in connection 
with these scales as the most satisfactory measurement * of the 
achievement of a class. This median score indicates the point * 
on the scale above and below which there are equal numbers 
of individual measures, and as such it represents the number of 
exercises or problems solved correctly by just fifty per cent of 
the class. That is, there are just as many students in a class who 
solve a larger number as there are students who solve a smaller 
number of exercises, 

V. TENTATIVE STANDARD SCORES 

Tentative standards of achievement based upon the results 
obtained thus far are given in Tables IV and V. They were cal- 
culated upon the basis of the total number of problems solved 
porrectly by each group. 

The reliability of such standard scores is determined very largely 
by the number of pupils tested, and, inasmuch as these numbers 
are small, it cannot be said that the scores are as yet definitely 
established. The median scores given for the nine-month group 
are, however, in all but the Graph Scale derived from the results 
totaling in the neighborhood of 1,500 cases, as will be seen from 
tables given farther on. These, it is believed, are quite reliable. 

In connection with these scores it should be noted, also, that very 
few of the classes when tested had studied algebra for the exact 
time specified, viz., three months, six months, and nine months. 
Such a procedure, though desirable, would have immeasurably 
complicated the task of submitting the tests and did not appear 
feasible. Care was taken, nevertheless, to see that the classes 
tested tended to group themselves quite evenly about these in- 
tervals, and in this way tended to offset the time inequalities 
which could not be avoided otherwise. 

^As a measure of the ability of a class when used in connection with the scales of 
Series B, where the steps between the problems are often very unequal, it is open 
to rather serious criticism, but because it involves less technical computation it is 
here adopted as being for all practical purposes the most satisfactory measure. 

*For instructions as to method of computing median scores see Thorndike, E. L.: 
Mental and Social Measurements, p. 36/; Rugg, H. O.: Statistical Methods Applied 
to Education, p. 109/; Whipple, G. M.: Manual of Mental and Physical Tests, p. 13. 
See also Appendix, p. 81. 
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TABLE IV 
Tentative Median Standards of Achievement, Series A 





Three-Month 


Six-Month 


Nine-Month 




Group 


Group 


Group 


Addition and Subtraction 


5.0 


6.8 


7.9 


Multiplication and Division 


5-3 


6.3 


7.9 


Equation and Formula 


4 9 


7.1 


7.8 


Problem Test 


4-3 


4.9 


5.6 


Graph Test 


2.8 (four 


and one-half 


5.6 




months) 





TABLE V 
Tentative Median Standards of Achievement, Series B 





Three-Month 


Six-Month 


Nine-Month 




Group 


Group 


Group 


Addition and Subtraction 


9.7 


12.9 


14.4 


Multiplication and Division 


9.6 


14.0 


16.3 


Equation and Formula 


7.8 


143 


16.0 


Problem Test 


5.4 


6.5 


7.5 


Graph Test 


3.7 (four 
n 


and one-half 
lonths) 


7.2 



Ill 

DERIVATION OF THE EQUATION 
AND FORMULA SCALE 

I. ARRANGEMENT OF MATERIAL 

The same plan of construction was used in deriving all the scales 
of this study. It is, therefore, necessary to explain in detail the 
method pursued in connection with the development of only one 
of the scales. The Equation and Formula Scale ^ has been selected 
for this purpose. 

The first step taken in the development of this scale was to 
assemble the results for all the problems of the equation and formula 
test in two different tables. These crude summaries are given 
in Tables VI and VII. 

Table VI represents the distribution of each of the three groups 
for the exercises in the Equation and Formula Scale. This table 
shows that eleven of the students who had studied algebra for 
three months and one of the students who had studied algebra for 
six months were unable to solve a single exercise. Nineteen in the 
first group and one in the second group were able to solve only 
one exercise, etc. There were 689 students tested who had studied 
algebra for three months, 746 who had studied algebra for six 
months, and 1612 who had studied algebra for nine months. 

This table also shows the median score for each group, that is, 
the number of exercises such that there are just as many students 
in the group who solve a greater number of exercises as there are stu- 
dents who solve a less number. The difference between the twenty- 
five percentile and the seventy-five percentile shows us the range 
in the number of exercises solved by the middle fifty per cent of 
the students of a group. One half of this difference gives us the 

^ All the essential data from which the other scales were derived are given in more 
condensed form in the last section. From these tables, after following the explana- 
tions given here, it will be comparatively easy to see how the final value of each 
problem was computed. 
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Distribution According to the Number of Equation 
and Formula Exercises Solved 
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fl» 



Number Solved 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


o 


II 


1 




I 


19 


I 




2 


24 


3 


4 


3 


26 


3 


I 


4 


37 


6 


6 


5 


63 


8 


10 


6 


87 


19 


14 


7 


98 


31 


18 


8 


93 


37 


30 


9 


102 


36 


58 


10 


44 


48 


72 


II 


37 


53 


106 


12 


19 


57 


106 


13 


II 


47 


127 


H 


9 


77 


139 


15 


4 


62 


115 


i6 


3 


77 


148 


17 


I 


60 


135 


i8 




56 


134 


19 


I 


28 


125 


20 




16 


93 


21 




10 


78 


22 




7 


44 


23 




2 


23 


24 




I 


12 


25 






4 


Number Tested 


689 


746 


1612 


Median ' 


7.791 


14.299 


16.000 


25 Percentile 


5.877 


10.865 


12.792 


75 Percentile 


9- 576 


16.915 


18.895 


Quartile 


1.849 


3.025 


3.051 



* In ordinary practice it is not necessary to work out the medians and percentiles farther 
than the first decimal place. To carry these out to three decimal places, as is often 
done in this study, suggests a degree of accuracy and refinement in statistics which 
these scales do not possess. 
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quartile, or semi-interquartile range, which is a measure of the 
variability of the group. 

Table VII indicates the number of students from each group 
that solved each exercise correctly. Thus, 665 of the students who 
had studied algebra for three months, 741 of the students who had 
studied algebra for six months, and i ,608 of those who had studied 
algebra for nine months, succeeded in getting the first exercise, etc. 



TABLE VII 

Number in Each Group That Solved Each Exercise 
in Equation and Formula Test Correctly 



Problem Number 


Three-Month 
Group 


Six- Month 
Group 


Nine-Month 
Group 


I 


665 


741 


1608 


2 


564 


714 


1552 


3 


597 


728 


1580 


4 


516 


693 


1504 


5 


465 


662 


1452 


6 


449 


687 


1496 


7 


328 


581 


1285 


8 


373 


567 


1284 


9 


275 


356 


1 1 10 


10 


333 


518 


1264 


II 


72 


538 


1290 


12 


119 


427 


103 1 


13 


43 


510 


1 133 


14 


17 


410 


1106 


15 


90 


209 

% 


776 


16 


5 


427 


1121 


17 


5 


299 


830 


18 


9 


274 


863 


19 


5 


155 


572 


20 


I 


144 


528 


21 




65 


286 


22 


3 


122 


397 


23 


2 


lOI 


408 


24 




8 


123 


25 




4 


46 


No. Tested 


689 


746 


1612 



The Equation and Formula Scale 45 

II. PROBABLE ERROR (P. E.) TAKEN AS THE UNIT OF MEASURE 

Scales aim to establish units of measurement which shall be 
both accurate and constant. In them values are scientifically es- 
tablished, standard conditions are maintained, and the personal 
element, which has played such a prominent part in the educational 
measurements in the past, is reduced to a minimum. Thus,. we are, 
able to get results which can be universally interpreted and com- 
pared. As instruments of measurement, scales are, therefore, in- 
finitely superior to the snap judgments of teachers, even after 
such judgments have been corrected by the results of a series of 
tests wherein the exact difficulty of each problem is necessarily 
more or less of an unknown quantity. 

In the construction of these algebra scales an attempt has been 
made to develop reliable objective instruments for measuring the 
ability of first year algebra students, instruments that can be used 
by different people in making measurements and yet get results^ 
that are comparable. The difficulty of each exercise or problem 
has been definitely established and its position above a selected, 
zero point determined. That is, the exercises have all been placed 
in their relative positions on a projected linear scale. In Series A, 
special effort was made to select exercises with equal steps of 
difficulty between them. 

Points and steps upon scales for measuring school products may 
be determined in one of two ways. They may be based upon the 
judgments of a number of persons competent to judge the order of 
difficulty of a series of problems; or, as was done in this study, 
such exercises or problems may be submitted to a number of pupils 
and then scaled in order of difficulty as determined by these results. 

The unit used in constructing these algebra scales is what is 
commonly known in statistical measurements as the median devia- 
tion or probable error (P. E.). It is a measure of variability and is 
the unit generally selected in the construction of scales because it 
is the most constant measure known.' 

Before going further into the discussion of the significance of 
P. E. as our unit of measure, it is, however, necessary to state 
here the fundamental assumptions upon which such a procedure 
depends. It assumes first, that the ability of pupils to solve the 

' For a more complete discussion of this question, consult Trabue, Marion Rex: Com- 
pietion-Test Language Scales, p. 30. 
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algebra exercises or problems is distributed within the respective 
groups (three-month group, six-month group, and nine-month 
group) according to the normal surface of distribution; and in the 
second place, it assumes that the variability of any one group 
is equal to that of any other group. 

Neither of these assumptions may be strictly valid, nor have they 
been scientifically established by the evidence which is available. 
It is, however, believed that for all practical purposes they offer 
the most reliable working basis which could be adopted at present/ 

According to the first of these assumptions — that the achievement 
of any group in the solution of algebra exercises or problems tends 




T«ry 



Average 



Many 



Y^ty lunjr 



Figure 3 

Normal Surface of Frequency Showing the Distribution of Achievement 

in the Solution of Exercises or Problems. 



to distribute itself normally — ^we should expect to find that most 
of the students solve about the same number of exercises, and that 
they cluster about the median or average for that group. Further- 
more, we should expect that there is a relatively small number of 
students who can solve only a few exercises and, likewise, only a 
few who can solve many more than the average number of exercises. 

^A few i>sychologists maintain that by the time the first year of the high school is 

reached the forces of selection have already operated to such an extent as to affect 

quite decidedly the normal distribution of ability to do scholastic work. They 

[[believe that elimination has taken place very largely in the lower half of the curve, 

and that our distribution should, therefore, be skewed just a little to the left. 

On the other hand, there are others who deny that such a positive skew really exists. 
They argue that by the time pupils reach the high school elimination has been due 
to a variety of interrelated causes, a number of which have nothing whatever to do 
with intellectual ability. 

That some selection on the basis of scholarship does take place may well be admitted, 
but on the whole it is as yet questionable whether this selection up to and into the high 
school is of such a nature as to change the form of the distribution to a marked 
degree. 
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In general, we should expect to find the achievement of these 
students distributed symmetrically on each side of the average. 
Fig. 3 illustrates such a distribution. All the students arranged 
according to the number of exercises solved are represented by the 
space enclosed between the curve and the base line. The height 
of the curve above the base line indicates the number of indi- 
viduals of the group that have the ability shown on the base line 



.100- 




£0 



Tft 



Viaib«r of lxerei««0 



Figure 4 

Distribution According to Number of Exercises Solved by 
Three-Month Group in Equation and Formula Test. 



100 




Figure s 
Distribution According to Number of Exercises Solved by 
Six-Month Group in Equation and Formula Test. 



scale, and each individual is represented by an equal amount of 
the enclosed area. Thus, at the extreme left, the curve is very 
near the base, which shows that the number of students who could 
solve only a few exercises was small. In the middle the curve is 
at a maximum distance from the base line, indicating the large 
number of students who solved an average number of problems, 
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while at the extreme right the curve is again very near the base, 
representing the small number of students who were able to solve 
a large number of problems. 

With these characteristics of the normal distribution curve in 
mind, it is interesting to note to what extent the achievement of 
students as shown by the exercises in the Equation and Formula 
test approximated the normal curve of distribution. Figs. 4, 5, and 
6 represent graphically the distribution of the various groups tested 
by the equation and formula exercises. 




Figure 6 

Distribution According to Number of Exercises Solved by 
Nine-Month Group in Equation and Formula Test. 



It will be seen from these figures that the three-month distri- 
bution is skewed positively just a little; and the nine-month dis- 
tribution, on the other hand, has a slight negative skew. In general, 
however, the figures bear a closer resemblance to the normal fre- 
quency curve than we would be led to expect.^ 

We are now prepared to define the unit of variability which has 
been adopted as the most convenient unit for the measurement 

* Several factors which have a tendency to distort the form of the distribution were 
operating. In the first place, the exercises used did not prove, as has already been 
seen (Fig. 2), to be such that they could be arranged upon a linear scale differing 
In difficulty by approximately equal amounts. That is, the exercises did not in- 
crease in difficulty by equal intervals, nor was there a sufficient number of very 
easy and of very difficult exercises in the test. In the second place, we cannot be 
certain that the groups were strictly speaking non-select with regard to intel- 
lectual ability. 
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of achievement in the construction of these scales. This, as stated 
above, is the median deviation or probable error and is usually 
designated by the letters P. E. It is defined as the median amount 
of deviation from the central tendency, and can perhaps be more 
satisfactorily explained in connection with Fig. 7. In this figure the 
perpendicular mn divides the normal surface of distribution into two 
equal parts, so that fifty per cent of the cases are on each side of this 
perpendicular. The point where the perpendicular cuts the base line 
is the median point. To the left of this point the perpendicular ab 
is drawn so as to include twenty-five per cent of the whole number 
of cases between this perpendicular and the median perpendicular. 




Figure 7 

Normal Surface of Distribution Showing the Median and the 
P. E. Distance on Each Side of the Median Point. 



Likewise, the perpendicular cd includes twenty-five per cent of the 
cases to the right of the median perpendicular. It will be seen 
that the area ahcd contains the middle fifty per cent of all the 
cases. The distance ma or mc on the base line of the surface of dis- 
tribution is the median deviation or P. E. 

Furthermore, it has been established that if a perpendicular be 
erected at a distance of 2 P. E. on the base line of the surface of 
frequency, and on either side of the median point, it will include 
with the median perpendicular 41.13 per cent of all the cases; 
if erected at a distance of 3 P. E. it will include 47.85 per cent of 
the cases; and if erected at a distance of 4 P. E. it will include 
49.65 per cent of the cases. In theory the curve and base line 
never meet and could be indefinitely extended, always getting 
nearer together but never touching. For the purposes of this 
study it has been considered sufficiently accurate to assume that 
they meet at a distance of 4.6 P. E. from the median, since the 
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perpendicular erected here on either side of the median cuts off 
only O.I per cent of all the cases. 

III. SCALING THE EXERCISES IN THE EQUATION 
AND FORMULA TEST FOR EACH GROUP 

Having adopted the P. E. of the distribution of a group as our 
unit of measure and having assumed that the ability of students 
in solving the equation and formula exercises is distributed according 
to the normal distribution curve, our next task is to locate each 




Figure 8 

Normal Surface of Frequency Showing P. E. Distances 

from the Median Point. 

exercise on the base line of each group distribution. An exercise 
that is solved correctly by just fifty per cent of the students of a 
group would represent the median achievement of the group and 
would very obviously be located at the median point on the base 
line. Since i P. E. represents the distance along the base line, on 
either side of the median, to a point where a perpendicular erected 
will include between this perpendicular and the median twenty- 
five per cent of the cases, it is evident that an exercise which is 
solved by only twenty- five per cent of the students is just one unit 
more difficult than the one just mentioned and should be located 
at -f I P. E. from the median point. Similarly, an exercise that is 
solved by seventy-five per cent of the group is considered as being 
one unit less difficult and so it is located at — i P. E. from the 
median. In this way after the per cent of students of a group 
that solved a certain exercise is known, the deviation of such exercise 
in per cents from the median or fifty per cent can be calculated. 
Such values may then in turn be translated into P. E. distances 
from the median achievement of the group, and thus a P. E. 
scale for each group can be constructed. 
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ProUem Number 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


I 


96.52 


99.33 


99.75 


2 


81.9 


95.7 


96.3 


3 


86.7 


97.6 


98.0 


4 


74.9 


92.9 


93.3 


5 


67- 5 


88.7 


90.1 


6 


65.2 


92.1 


92.8 


7 


47.6 


77.9 


79.7 


8 


54.1 


76.0 


79.6 


9 


39.9 


47.7 


68.9 


10 


48.3 


69.4 


78.4 


II 


10.5 


72.1 


80.0 


12 


17.3 


57.2 


63.8 


13 


6.2 


68.4 


70.3 


14 


2.5 


55.0 


68.6 


15 


13.1 


28.0 


48.1 


16 


.7 


57.2 


69.5 


17 


.7 


40.1 


51.5 


18 


1.3 


36.7 


53-5 


19 


.7 


20.8 


35.5 


20 


.2 


19.3 


32.7 


21 




8.7 


17.7 


22 


•4 


16.3 


24.6 


23 


.3 


13.5 


25.3 


24 




I.I 


7.6 


25 




•53 


3.47 



Table VIII has been constructed from Table VII (page 44). It 
gives the percentage of each group that solved each of the equation 
apd formula exercises. For example, from Table VII we note that 
665 out of a total of 689 students in the three-month group solved 
the first exercise. Table VII gives this as 96.52* per cent. 

* It is ordinarily necessary to carry this out to only one decimal place but inasmuch as 
the corresponding P. E. distances upon the base line become increasingly large at 
the extreme ends of the distribution such values are here calculated to two decimal 
places. 
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TABLE IX 

Difference Between Fifty Per Cent and the Per Cent in Each Group 
That Solved Each Exercise in Equation and Formula Test 



Problem Number 


Three-Month 
Group 


Six- Month 
Group 


Nine-Month 
Group 


I 


46.52 


49.33 


49.75 


2 


31.9 


45.7 


46.3 


3 


36.7 


47.6 


48.0 


4 


24.9 


42.9 


43.3 


5 


17.5 


38- 7 


40.1 


6 


15.2 


42.1 


42.8 


7 


-2.4 


27.9 


29.7 


8 


4.1 


26.0 


29.6 


9 


— 10. 1 


-2.3 


18.9 


10 


-1.7 


19.4 


28.4 


II 


-39-5 


22.1 


30.0 


12 


-32.7 


7.2 


13.8 


13 


-43.8 


18.4 


20.3 


14 


-47.5 


5«o 


18.6 


15 


-36.9 


—22.0 


-1.9 


i6 


-49.3 


72 


19.5 


17 


-49-3 


-9.9 


1.5 


i8 


-48.7 


-13.3 


3.5 


19 


-49-3 


—29.2 


-14.5 


20 


-49.8 


-30.7 


-17.3 


21 




-41.3 


-32.3 


22 


-49.6 


-33.7 


-25.4 


23 


-49.7 


-36.5 


-24.7 


24 




-48.9 


-42.4 


25 




-49.47 


-47.15 



Table IX shows the deviation from the median achievement of 
each group. It is obtained by subtracting fifty per cent from the 
per cents given in Table VIII. 

Table X has been calculated mathematically ^ and is introduced 
here to be used in connection with Table IX. It indicates the 
corresponding P. E. value for each o.i per cent deviation from 
the median. 

7 Table X is taken directly from Spelling Ability, Table XLVIII, by B. R. Buckingham. 
It is a revision of the table given in Mental and Social Measurements, p. 198, by 
E. L. Thorndike. 
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TABLE X 

P. E. Values Corresponding to Given Per Cents of the Normal Surface 
of Frequency, Per Cents Being Taken From the Median 








.1 


.2 


J 


'4 


.5 


.6 


'7 


.8 


'9 





.000 


.004 


.007 


.011 


.015 


.019 


.022 


.026 


.030 


.033 


I 


.037 


.041 


.044 


.048 


.052 


.056 


.059 


.063 


.067 


.071 


2 


.074 


.078 


.082 


.085 


.089 


.093 


.097 


.100 


.104 


.108 


3 


.112 


"5 


.119 


.123 


.127 


.130 


.134 


.138 


.141 


.145 


4 


.149 


.153 


.156 


.160 


.164 


.168 


.172 


.175 


.179 


.183 


5 


.187 


.190 


.194 


.198 


.201 


.205 


.209 


.213 


.216 


.220 


6 


.224 


.228 


.231 


.235 


.239 


.243 


.246 


.250 


.254 


.258 


7 


.261 


.265 


.269 


.273 


.277 


.280 


.284 


.288 


.292 


.296 


8 


.299 


.303 


.307 


.311 


.315 


.318 


.322 


.326 


.330 


.334 


9 


.337 


.341 


.345 


.349 


.353 


.357 


.360 


.364 


.368 


.372 


10 


.376 


.380 


.383 


.387 


.391 


.395 


.399 


.403 


.407 


.410 


II 


.414 


.418 


.422 


.426 


.430 


.434 


.437 


.441 


.445 


.449 


12 


.453 


.457 


.461 


.464 


.468 


472 


.476 


.480 


.484 


.489 


13 


.492 


.496 


.500 


.504 


.508 


.512 


.516 


.519 


.523 


.527 


14 


.531 


.535 


.539 


.543 


.547 


.551 


.555 


.559 


.563 


.567 


15 


.571 


.575 


.579 


.583 


.588 


.592 


.596 


.600 


.603 


.608 


16 


.612 


.616 


.620 


.624 


.628 


.632 


.636 


.640 


.644 


.648 


17 


.652 


.656 


.660 


.665 


.669 


.673 


.677 


.681 


.685 


.689 


18 


.693 


.698 


.702 


.706 


.710 


.714 


.719 


.723 


.727 


.731 


19 


.735 


.740 


.744 


.748 


.752 


.756 


.761 


.765 


.769 


.773 


20 


.778 


.782 


.786 


.790 


.795 


.799 


.803 


.807 


.812 


.816 


21 


.820 


.825 


.829 


.834 


.838 


.842 


.847 


.851 


.855 


.860 


22 


.864 


.869 


.873 


.878 


.882 


.886 


.891 


.895 


.900 


.904 


23 


.909 


.913 


.918 


.922 


.927 


.931 


.936 


.940 


.945 


.949 


24 


.954 


.958 


.963 


.968 


.972 


.977 


.982 


.986 


.991 


.996 


25 


1. 000 


1.005 


1.009 


1.014 


1.019 


1.024 


1.028 


1.033 


1.038 


1.042 


26 


1.047 


1.052 


1.057 


1.062 


1.067 


1. 07 1 


1.076 


1.081 


1.086 


1. 091 


27 


1.096 


I.IOI 


1. 105 


I. no 


1. 115 


1. 120 


1. 125 


1. 130 


1.135 


1. 140 


28 


1. 145 


1. 150 


1.155 


1. 160 


1. 165 


1. 170 


1. 176 


1. 181 


1. 186 


1. 191 


29 


1. 196 


1. 201 


1.206 


I.2II 


1.217 


1.222 


1.227 


1.232 


1.238 


1.243 


30 


1.248 


1.253 


1.259 


1.264 


1.269 


1.275 


1.279 


1.286 


1. 29 1 


1.296 


31 


1.302 


1.307 


1.313 


I.318 


1.324 


1.329 


1.335 


1.340 


1.346 


1.351 


32 


1.357 


1.363 


1.368 


1.374 


1.380 


1.386 


1. 391 


1.397 


1.403 


1.409 
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TABLE X— {Continued) 

P. E. Values Corresponding to Given Per Cents of the Normal Surface 
of Frequency, Per Cents Being Taken from the Median 








.1 


.2 


.J 


.4 


.5 


.6 


'7 


.8 


'9 


33 


1.415 


1.421 


1.427 


1.432 


1.438 


1.444 


1.450 


1.456 


1.462 


1.469 


34 


1.475 


1.481 


1.487 


1.493 


1.499 


1.506 


1.512 


1.518 


1.524 


1.531 


35 


1.537 


1.543 


1.549 


1.556 


1.563 


1.569 


1.576 


1.582 


1.589 


1.595 


36 


1.602 


1.609 


1.616 


1.622 


1.629 


1.636 


1.643 


1.649 


1.656 


1.663 


37 


1.670 


1.677 


1.685 


1.692 


1.699 


1.706 


1.713 


1.720 


1.728 


1.735 


38 


1.742 


1.749 


1.757 


1.765 


1.772 


1.780 


1.788 


1.795 


1.803 


1.811 


39 


1.819 


1.827 


1.835 


1.843 


1.851 


1.859 


1.867 


1.875 


1.884 


1.892 


40 


1.900 


1.909 


1. 91 8 


1.926 


1.935 


1.944 


1.953 


1.962 


1.971 


1.979 


41 


1.988 


1.997 


2.007 


2.016 


2.026 


2.035 


2.044 


2.054 


2.064 


2.074 


42 


2.083 


2.093 


2.103 


2.114 


2.124 


2.134 


2.145 


2.155 


2.166 


2.177 


43 


2.188 


2.199 


2.211 


2.222 


2.234 


2.245 


2.257 


2.269 


2.281 


2.293 


44 


2.305 


2.318 


2.331 


2.344 


2.357 


2.370 


2.384 


2.397 


2.41 1 


2.425 


45 


2.439 


2.453 


2.468 


2.483 


2.498 


2.514 


2.530 


2.546 


2.562 


2.579 


46 


2.597 


2.614 


2.631 


2.648 


2.667 


3.686 


2.706 


2.726 


2.746 


2.767 


47 


2.789 


2.81 1 


2.834 


2.857 


2.881 


2.905 


2.932 


2.958 


2.986 


3.015 


48 


3.044 


3.077 


3.111 


3.146 


3.182 


3.219 


3.258 


3.300 


3.346 


3.395 


49 


3.450 


3.506 


3.571 


3.643 


3.725 


3.820 


3.938 


4.083 


4.275 


4.600 


50 























Table XI gives the P. E. value of each exercise for each group 
distribution, and so indicates the position on the base line with 
reference to the median achievement of each exercise for each dis- 
tribution. From this table, then, the difficulty of any exercise 
for any group may be found. 

To assist in a fuller interpretation of these tables as used in find- 
ing the difficulty of an exercise by locating it on the base line of 
one of the group distributions, let us find the position of the second 
exercise as determined by the achievement of the nine-month 
group. By referring to Table VII, we find that 1,552 of the 1,612 
students who tried exercise No. 2 solved it correctly. Table VIII 
shows that this is 96.3 per cent of the total number who tried it, or, 
according to Table IX, 46.3 per cent more than the median achieve- 
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P. E. Equivalent of Difference Between Fifty Per Cent and the Per Cent 
in Each Group That Solved Each Exercise in Equation and 

Formula Test 



Problem Number 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


I 


-2.688 


-3.668 


-4.159 


2 


-1. 351 


-2.546 


-2.648 


3 


-1.649 


-2.932 


-3.044 


4 


—0.996 


-2.177 


—2.222 


5 


-0.673 


-1.795 


-1.909 


6 


-0.579 


-2.093 


—2.166 


7 


0.089 


— 1 . 140 


-1.232 


8 


-0.153 


-1.047 


— 1 . 227 


9 


0.380 


0.085 


-0.731 


10 


0.063 


-0.752 


-1. 165 


II 


1.859 


-0.869 


-1.248 


12 


1.397 


—0.269 


-0.523 


13 


2.281 


—0.710 


-0.790 


H 


2.905 


-0.187 


-0.719 


15 


1.663 


0.864 


0.071 


i6 


3.643 


—0.269 


-0.756 


17 


3.643 


0.372 


-0.056 


i8 


3.300 


0.504 


-0.130 


19 


3.643 


1.206 


0.551 


20 


4.275 


1.286 


0.665 


21 




2.016 


1.374 


22 


3.938 


1.456 


1. 019 


23 


4.083 


1.636 


0.986 


24 




3.395 


2.124 


25 




3.791 


2.822 



ment. The corresponding P. E. value of 46.3 per cent as obtained 
from Table X is 2.648 ; and since this exercise is just that much too 
easy when compared with the median achievement of the nine-month 
group, it is located this distance below the median, or as seen in 
Table XI at —2.648 P. E. The same exercise is located, as can be 
seen from the same table, at —2.546 P. E. in the six-month dis- 
tribution and at — 1.351 P. E. in the three-month distribution. 
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IV. MEASUREMENT OF DISTANCES BETWEEN THE MEDIANS 

OF SUCCESSIVE GROUPS 

We have now succeeded in locating each exercise at its proper 
distance from the median point of each group distribution. That 
is, we have established a P. E. scale for each of the three groups. 
It is our purpose ultimately, however, to locate each exercise upon 
one linear scale so as to know how difficult each exercise is in general. 
To do so we must next find the P. E. distance between the con- 
secutive groups. 

Three methods were used in this study to determine these inter- 
group intervals. They are here designated as the 'problem method', 
the *quartile method*, and the 'overlapping method*. 

By the problem method the distance between two consecutive 
groups is determined by the difference in position which each 
exercise holds within each respective group with reference to the 
median. It will be seen that this method not only assumes that 
the achievement of students in solving the exercises is distributed 
according to the normal frequency curve, but, as may also be 
inferred from the above, that their achievement in solving each 
individual exercise tends to be likewise distributed. The intervals 
are calculated from Table XI. According to this table, the third 
exercise has a P. E. value for the three-month group of —1.649, 
and in the six-month group it has a P. E. value of —2.932. The 
difference between these two values gives us 1.283, which is the 
P. E. distance between these two groups as determined by this 
exercise. Each exercise gives us a separate measure of the interval 
between successive groups. These intervals have been calculated 
for all the exercises in the equation and formula test and are recorded 
in Table XII. 

In connection with this table, some attention must be given to 
the fact that the more difficult the exercise the larger the interval 
between two consecutive groups tends to become. That this is 
true is more clearly shown for these exercises in Table XIII. In 
this table the intergroup intervals as determined by the various 
exercises are classified roughly according to the difficulty of the 
exercise. The results marked below —1.5 P. E. are the averages 
of those determinations in Table XII which came from values 
any one or both of which in Table XI were lower than — 1.5 P. E.; 
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the results marked —1.5 P. E. to +1.5 P. E. are the averages of 
those determinations which came from values both of which were 
between —1.5 P. E. and +1.5 P. E.; and the results marked above 
+ 1.5 P. E. are the averages of those determinations which came 
from values any one or both of which were above +1.5 P. E. The 
results marked 'select class' are the averages of those determina- 
tions only which were derived from values between —2 P. E. and 
+2 P. E., while the 'composite average' is the average of all the 
determinations given in Table XII. 

TABLE XII 

P. E. Interval Shown Between Consecutive Groups 
by Each Equation and Formula Exercise 



Problem Number 


Three- to Six- 
Month Interval 


Six- to Nine- 
Month Interval 


I 


.980 


.491 


2 


1. 195 


.102 


3 


1.283 


.112 


4 


1. 181 


.045 


5 


1. 122 


.114 


6 


1. 514 


.073 


7 


1.229 


.092 


8 


.894 


.180 


9 


.295 


.816 


10 


.815 


.413 


II 


2.728 


.379 


12 


1.666 


.254 


13 


2.991 


.080 


14 


3.092 


.532 


15 


.799 


.793 


16 


3.912 


.487 


17 


3.271 


.428 


18 


2.796 


.634 


19 


2.437 


.655 


20 


2.989 


.621 


21 




.642 


22 


2.482 


.437 


23 


2.447 


.650 


24 




1. 271 


25 




.969 



58 



First Year Algebra Scales 



TABLE XIII 

Average of Various Determinations of Intergroup Intervals 
as Measured by the Equation and Formula Exercises 



P. E. Value Below —1.5 
-1.5P. E. to +1.5 P. E. 
Above +1.5 P. E. 
Select Class 
Composite Average 



Three- to Six- 


Sioc- to Nine- 


Month Interval 


Month Interval 


1. 214 


.156 


.980 


.453 


2.722 


.883 


1. 194 


•445 


1. 914 


.451 



The results as a whole show that each group is superior to the 
one next below it in the solution of all exercises, but the largest 
diflferences are brought about by the difficult exercises.^ One 
exception to this general rule occurs in Table XIII, and it is the 
only one found in this entire study. It will be seen that the average 
interval of the exercises —1.5 P. E. to +1.5 P. E. happens to be 
smaller for the three- to six-month interval than it is for the easier 
exercises, that is, for those below — 1.5 P. E. This may be explained 
in the first place by the fact that only five cases fell between these 
limits, and in the second place three of these exercises happened to 
be almost as easy for the three-month group as they were for the 
nine-month group. 

Several plans could be pursued in making the final determinations 
of the intergroup intervals by the 'problem method*. The easy 
exercises tend to give us a small intergroup interval, while the 
difficult ones tend to increase this difference between the medians 
of two consecutive groups. Of these two types of exercises the 
difficult ones probably give us the more reliable measure; but, on 
the whole, it would seem that the best measure of the interval is 
the average of those determinations that came from exercises near the 
median. These should, therefore, be weighted while those exercises 
which are more than 3 or 4 P. E. from the median should perhaps not 
be allowed to influence the measure of the interval at all. In this 
study both the composite average and the average of those de- 

* This fact was noted by Dr. Trabue and also by Dr. Woody in their scale studies 
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terminations given in Table XII which were obtained from values 
—2 P. E. to +2 P. E. in Table XI were used in making the final 
calculations. The latter is designated in Table XIII as the 'select 
class*; and, inasmuch as this measure is in all probability more 
reliable than the composite average, it has seemed advisable to 
give it double weight. The final determinations of the intergroup 
intervals by the 'problem method* are therefore as follows: 





Three- to Six- 
Month Interval 


Six- to Nine- 
Month Interval 


Select Class 
Select Class 
Composite Average 


1. 194 
1. 194 
1,914 


.445 
•445 
•451 


Average 


I 434 


'447 



The second method adopted to get a 'measure of the distance * 
between the group medians has been designated as the 'quartile 
method*. This method uses the quartile as a measure of P. E. 
The quartile as we have already noted in connection with Table 
VI is one-half of the range of the middle fifty per cent. If then, 
as we have assumed in this study, we have a normal surface of 
distribution, the quartile is exactly equal to the P. E. We can, 
therefore, divide our crude score interval by the quartile of the 
distribution and get another measure of our intergroup intervals 
in terms of P. E. 

Table XIV shows the intergroup intervals obtained by this 
process. 

This table is constructed from data taken from Table VI. The 
crude score interval is the difference between the median scores. 
That is, the difference between the median number of problems 
solved by successive groups. Since there are two quartile measures 
for each crude score interval, the average of the two is taken as the 
divisor of the crude score interval. Thus, to get in terms of P. E. 
the measure of the distance between the medians of the three-month 
and the six-month groups by the 'quartile method*, we subtract 
7.791 from 14.299. This gives us the crude score interval of 6.508. 
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The average quartile is then found by taking the average of the 
quartiles 1.849 and 3.025, which is 2.437. Finally, the quartile 
interval is calculated by dividing 6.508 by 2.437, which is 2.671. 

TABLE XIV 
Determination of Quartile Intervals Between the Groups 





Three- Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


Median 
Quartile 


7.791 
1.849 


14.299 
3 025 


16.000 
3.051 


Crude Score Interval 
Average Quartile 
Quartile Interval 


6.508 

2.437 
2.671 


I 
3 


.801 
.038 
.592 



The third method of calculating the intergroup intervals is based 
upon the amount of overlapping by consecutive group distributions. 
By this method that part of the group distribution which lies 
between its own median and that of another is translated directly 
into a P. E. value, and so gives us another measure of the distance 
between group medians. 

Reference to Table VI reveals the fact that many students of 
the three-month group surpassed the median score of the six- 
month group; and, conversely, that many students of the six-month 
group fell below the median score of the three-month group. Be- 
tween the median of the first group, which is 7.791, and that of the 
second group, which is 14.299, there are (assuming that the scores 
within each step are spread evenly over that step) 329.13 of the 689 
scores, or 47.77 per cent of the individuals in the three-month dis- 
tribution. Since this per cent is a deviation from the median or 
fifty per cent, it can be turned directly into a P. E. value by the 
aid of Table X. Its P. E. value is 2.978. This is known in Table 
XVI as the 'lower direct' measure of the three- to six-month interval. 
Similarly, it is found that 41.22 per cent of the individuals of the 
six-month distribution are included between the medians 7.791 
and 14.299, and the P. E. equivalent of 41.22 per cent is 2.009. 
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This is known as the 'upper direct* measure of the three- to six-month 
interval. 

It is possible also to obtain an indirect measure of this same 
interval. Between the three-month median and the nine-month 
median lies 46.95 per cent of the nine-month distribution. Thus, 
referring again to Table X, we may say that the three-month 
median, as measured by the nine-month distribution, is 2.780 P. E. 
below the nine-month median. Likewise, between the nine-month" 
median and the six-month median, there is included 13.18 per cent 
of the nine-month distribution, which makes the P. E. distance 



TABLE XV 

Percentages, with P. E. Equivalents, of the Scores of Each Group Lying 
Between Its Median and the Median for the Neighboring Group 





PERCENTAGES WITH EQUIVALENTS, 
DISTRIBUTION OF 


To Median of Group 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


Three-Month Group, Per Cent 

P.E. 

Six-Month Group, Per Cent 

P.E. 

Nine-Month Group, Per Cent 

P.E. 


47.77 
2.978 

49.27 
3 621 


41.22 
2.009 

15.55 
.594 


46.95 
2.780 

13.18 
.499 



between the six- and nine-month medians .449. Finally, by sub- 
tracting the six- to nine-month interval, .499 P. E., from the three- to 
nine-month interval, 2.780 P. E., we get 2.281 P. E., which is the 
other measure of the three- to six-month interval as determined 
by the nine-month distribution. This is known as the 'upper 
indirect' measure. 

All the essential data for the computation of both the direct 
and indirect measures of the intergroup intervals are given in more 
concise form in Table XV. 

For the final calculations of the distances between the medians 
of the three different groups by the 'overlapping method', double 
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weight has been given to all direct measures and single wei^t to 
all indirect measures. These results are given in tabular form 
in Table XVI. 

TABLE XVI 

Determination of Intergroup Intervals From Overlapping 
of Distributions in Equation and Formula Test 



Determination 



Three- to Six- 
Month interval 



T 



Six- to Nine- 
Month Interval 



Lower Indirect 
Lower Direct 
Lower Direct 
Upper Direct 
Upper Direct 
Upper Indirect 

Total 
Average 



2.978 
2.978 
2.009 
2.009 
2.281 

2.463 



643 
594 
594 
499 
499 



2.82g 
.566 



^ Values for the distances between the group medians have now 
been worked out in three different ways. Each method possesses 
some merit; but the writer feels that the 'problem method* is 
perhaps the least reliable because it is subject to such extreme 
variations and that, all facts considered, the 'overlapping method* 
is the most consistent. It has, therefore, seemed wisest to attach 

--double weight to the results obtained by the 'overlapping method* 
and single weight to each value obtained by the other two methods. 
The results of these calculations together with the final average are 
given in Table XVII. These averages will be used in the further 
development of the Equation and Formula Scale. 

V. ESTABLISHING THE ZERO POINT 

One thing more remains to be done before we can locate the 
exercises of the equation and formula test upon a linear scale. So 
far, we have merely located each exercise a specified ntmiber of 
units above or below the median performance of a group. We wish 
to knowr ultimately, exactly how many units of difficulty each 
exercise represents and how many times as difficult one exercise 
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is than another. To do this, it is necessary to locate each exercise 
witi reference to a common zero point. 

Zero points may be absolute or they may be arbitrary. Since 
it would be difficult to find exercises so easy that to be unable to 
solve them would signify that the student had absolutely no alge- 
braic ability, it will be necessary to choose arbitrary zero points 
for these scales. Zero points on these scales will, therefore, mean 

TABLE XVII 

Final Determinations of Intervals Between Successive Groups 

for Equation and Formula Test • 





Three- to Six- 


Sioc- to Nine- 




Month Interval 


Month Interval 


Problem Method 


1.434 


.447 


Quartile Method 


2.671 


.592 


Overlapping Method 


2.463 


.566 


Overlappmg Method 


2.463 


.566 


Average Used as Final 


2.258 


.543 


Measurement 







simply the absolute inability to solve correctly any printed exercise ; 
which is as difficult as the easiest one used in these tests. The 
zero pointy then, as used in these scales does not mean just not 
any algebraic ability at all, but it means simply the zero point 
for ability to solve the printed exercises as given in these tests. It 
is entirely possible that if the exercises had been presented orally 
to the students of the first, or three-month group, they would have 
solved more of them correctly. Some of the students who were 
unable to solve a single exercise, as the test was presented to them, 

• Intergroup intervals for each of the other tests were determined by the same methods. 
These were found to be as follows: 

Three- to Six- Six- to Nine- 

Month Interval Month Interval 

Addition and Subtraction 1.387 -466 

Multiplication and Division 1.685 .852 

Problems . 689 . 526 

Graphs (Four and one-half to Nine-Month Interval) 2 . 366 
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would in all probability have solved at least one of them if the test 
had been presented orally. Furthermore, the scales were developed 
independently of each other, therefore, each has its own zero point. 
We cannot say that the zero point on one scale is equal to the zero 
point on another, nor can we say that an exercise which has a value 
of one on one scale is of the same difficulty as an exercise that has 
the same value on another scale, because it is obvious that we cannot 
treat values as being equal which have been developed from dif- 
ferent zero points. 

The zero point for the Equation and Formula Scale was de- 
termined by the following methods. Table VI shows that 11 of 
the 689 students of the first group made a score of zero, which 
means that they received no score at all. Between these students 
and the median of the group (7.791) there were 333.5 students or 
48.40 per cent of the whole group. Since this represents a devia- 
tion from the median or fifty per cent, it can be turned directly 
into a P. E. distance. Reference to Table X shows that a deviation 
of 48.40 per cent from the median of a normal distribution repre- 
sents a distance of 3.182 P. E. According to this method, therefore, 
the median of the three-month group is just 3.182 P. E. above 
no score at all. 

Another determination for the location of the zero point may be 
similarly obtained from the distribution of the six-month group. 
Table VI shows that only one student failed to make a score. There 
are, therefore, 372 students or 49.87 per cent of the whole group 
between the median achievement and those students who could 
not get a single exercise. This method would locate the six-month 
median 4.5 P, E. above zero. But we have just determined in the 
previous section (Table XVII) that the six- month median was 
2.258 P. E. above the three-month median. Subtracting 2.258 
P. E. from 4.5 P. E. we get 2.242 P. E., which is another value, 
though a somewhat more indirect one, of the distance the three- 
month median is located above the zero point. 

Again, the median score of the three-month group as shown by 
Table VI is 7.791 and the quartile is 1.849. Assuming that the 
quartile is equal to the P. E., as it is in a normal surface of dis- 
tribution, then by dividing the median achievement by the quartile 
we get 4.214 P. E., which is a third measure of the distance between 
our zero point and the median of the three-month group. 
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In the same way, by dividing the median achievement of the six- 
month group, which is 14.299, by the quartile for that group, which 
is 3.025, we get 4.727 P. E., the distance the six-month median 
is located above zero. Then subtracting the distance the six-month 
median is above the three-month median, 2.258 P. E., from the 
distance the six-month median is above zero, 4.727 P. E., we get 
2.469 P. E., which is another indirect measure of the distance from 
zero to the three-month median. 

We now have four determinations of the distance below our 
three-month median at which the zero point may be located. 
Undoubtedly those values based upon the results of the three-month 
group achievement are much more reliable, because the indirect 
measures — those based on the results of the six-month group — 
involve measurements taken at the utmost extremity of the curve 
(4.5 P. E.), and at this extreme range accident may unduly affect 
the results. It has, therefore, seemed best to give the indirect 
determinations single weight while the direct ones are given triple 
weight. The final determinations are as follows: 

From three-month distribution, 3.182 
From three-month distribution, 3.182 
From three-month distribution, 3.182 
From six-month distribution, 2.242 
From three-month achievement, 4.214 
From three-month achievement, 4.214 
From three-month achievement, 4.214 
From six-month achievement, 2.469 



Final average 3.362 

Thus, we have established our arbitrary zero point for the equa- 
tion and formula exercises^® at 3.362 P. E. below the median of 
the three-month group. 

With the median of the three-month group located at 3.362 P. E. 
above zero, and knowing the distance between the medians of each 
successive group, it is easy to determine the distance each group 
median is above the zero point. These distances are shown in 
Table XVIII. 

^**The distances of the arbitrary zero point below the median of the three-month 
group for the other exercises and problems are: 

Addition and Subtraction 3 . 826 

Multiplication and Division 4 067 

Problems 4- 219 

Graphs (below four and one-half month group) 3 . 304 
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TABLE XVIII 
Distances the Median of E^ch Group is Above Zero (i =»P. E.) 



Group 


Above Zero 


Below Next Group 


Three- Month Group 
Six- Month Group 
Nine-Month Group 


3.362 
5.620 
6.163 


2.258 
.543 



Fig. 9 illustrates graphically upon a linear scale the relative 
position of each of the group medians with reference to each other 
and with reference to their common zero point. 




F.S. Soal« 



Figure 9 

Relation to Each Other of the Three-, Six-, and Nine-Month Group 
Distributions in the Equation and Formula Test. 

These values are taken from Table XVIII, and are, of course, 
based upon the assumption that achievement in the solution of 
the exercises is distributed in accordance with the normal surface 
of frequency. 



VI. LOCATION OF EACH EXERCISE UPON A LINEAR SCALE 

Before we are prepared to locate each exercise of the equation 
and formula test upon a linear scale and thus determine the general 
difficulty of each exercise, it is necessary to determine how far above 
the zero point each problem is located for each of the three groups. 
That is, we must refer each exercise to the common zero point. 

Table XI shows that exercise No. i is 2.688 P. E. below the 
median of the three-month group, but Table XVIII indicates that 
this median is 3.362 P. E. above the zero point. Therefore, the 



The Equation and Formula Scale 



67 



distance above zero at which this exercise is located for the three^• 
month group is obtained by subtracting 2.688 P. E. from 3.362 
P. E., which equals .674 P. E. Likewise, by subtracting 3.668 P. E. 
from 5.620 P. E., the distance the six-month median is located 

TABLE XIX 
Location Above Zero of Each Equation and Formula Exercise 



Problem Number 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


I 


.674 


1.952 


2.004 


2 


2. on 


3.074 


3 515 


3 


1. 713 


2.688 


3. "9 


4 


2.366 


3.443 


3 941 


5 


2.689 


3.825 


4-254 


6 


2.783 


3 527 


3.997 


7 


3.451 


4.480 


4-931 


8 


3.209 


4.573 


4 936 


9 


3 742 


5.705 


5-432 


ID 


3.425 


4.868 


4.998 


II 


5.221 


4-751 


4.915 


12 


4-759 


5.351 


5.640 


13 


5.643 


4.910 


5-373 


14 


6.267 


5.433 


5.444 


15 


5 025 


6.484 


6.234 


16 


7.005 


5.351 


5.407 


17 


7.005 


5.992 


6.107 


18 


6.662 


6.124 


6.033 


19 


7.005 


6.826 


6.714 


20 


7.637 


6.906 


6.828 


21 




7.636 , 


7.537 


22 


7.300 


7.076 


7.182 


23 


7-445 


7 256 


7.149 


24 




9 015 


8.287 


25 




9. 411 


8.985 



above zero, we get 1.952 P. E., which is the location above zero 
of the same exercise as determined by the six-month group. In 
this way, the location above zero of each exercise, as determined 
by each of the three groups, was calculated. These results are 
recorded in Table XIX. As a further explanation of the method 
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pursued in constructing this table, it should be noted that all 
negative values in Table XI indicate distances below, and that all 
positive values indicate distances above the median of a group. 
Wherever positive values are given in Table XI, it is, therefore, 
necessary to add this P. E. distance to the P. E. distance given in 
Table XVIII. For example, the location of exercise No. 15, as 
determined by the nine-month group, is 6.163 P. E.+.071 P. E. 
or 6.234 P" E. above zero. 

We now have three values of the P. E. distance above zero at 
which each exercise may be located, one value as determined by 
the achievement of the three-month group, another as determined 
by the achievement of the six-month group, and a third as de- 
termined by the achievement of the nine-month group. Our final 
task is to determine the value of each exercise in general and to 
locate it upon one linear scale. 

A study of Table XIX reveals the fact that there is a tendency 
for the easy exercises to be located higher up on the scale the more 
advanced the group; on the other hand, the difficult exercises are 
located farther up on the scale the less advanced the group. This we 
would naturally expect, since each group of students is likely to do its 
best, relatively speaking, upon those exercises which correspond most 
closely with the degree of advancement of the group. For this 
and other reasons, the most reliable measure of the difficulty of an 
exercise may be obtained from that distribution whose median of 
achievement is nearest to the actual position of the exercise on 
the scale; and, since our aim in these final calculations is to find 
that position which best represents the difficulty of each exercise, 
it will be necessary to weight our values accordingly. In the final 
determinations it was, therefore, decided to give quadruple weight 
to those values in Table XIX when the exercise is less than i P. E. 
distance from the median achievement of the group as seen in 
Table XI, triple weight if the exercise is more than i P. E. but 
less than 2 P. E. distance from the median achievement of the 
group, double weight if it is more than 2 P. E. but less than 3 P. E., 
single weight if it is more than 3 P. E. but less than 4 P. E.," and 
not to consider it at all if it is beyond 4 P. E. 
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Fig. 10 shows the influence of the various parts of a distribution 
in determining the final value of an exercise according to the above 
system of weighting. 




-4P.B. 



-2F.B. 



♦EP.B. 



•^4P.B. 



Figure 10 



Showing the Influence of the Various Parts of a Distribution 
in Determining the General Value of an Exercise. 

To illustrate the way this system of weighting works, let us 
calculate the general value of exercise No. 3. 





Value 
Table XIX 


P, E. Deviation 
Table XI 


Three-Month Determination 
Three-Month Determination 
Three-Month Determination 
Six-Month Determination 
Six- Month Determination 
Nine-Month Determination 


1. 713 

1. 713 

1. 713 
2.688 

2.688 
3119 


-1.649 

— 2.932 
-3.044 


Average Determination 


2.272 





In this way, the general value of each exercise was calculated. 
These values are given in Table XX. They are final values, and 
locate the distance of each exercise above an arbitrary zero point 
upon a linear scale. 

u Inasmuch as our group medians were bunched so closely together » it was necessary 
to use the values at these extreme ranges more extensively than would otherwise 
have been necessary. 
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TABLE XX 
Final Value of Equadcm and Formula Exercises 



Rank 


Problem Number " 


Value 


I 


I 


I. ID 


2 


3 


2.27 


3 


2 


2.74 


4 


4 


3.03 


5 


6 


3.27 


6 


5 


3.49 


7 


8 


4.13 


8 


7 


4.20 


9 


10 


4.38 


10 


II 


4-94 


II 


9 


4.96 


12 


13 


5.24 


13 


12 


5.29 


14 


i6 


5.5^ 


15 


H 


560 


i6 


15 


5 99 


17 


i8 


6.14 


i8 


17 


6.17 


19 


19 


6.79 


20 


20 


6.86 


21 


22 


7.15 


22 


23 


7.19 


23 


21 


7.5« 


24 


24 


8.53 


25 


25 


9.13 



^* Numbers given here indicate the position of the exercise in the test series. 
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TABLES OF CRUDE DATA FROM WHICH THE 
OTHER SCALES WERE DERIVED 

TABLE XXI 

Distribution According to the Number of Addition 
and Subtraction Exercises Solved 





Three-Month 


Six-Month 


Nine-Month 




Group 


Group 


Group 





7 




3 


I 


7 


I 




2 


10 




3 


3 


14 


4 


5 


4 


29 


I 


9 


5 


44 


II 


5 


6 


73 


19 


21 


7 


84 


30 


28 


8 


98 


36 


35 


9 


"7 


54 


50 


lO 


105 


62 


86 


II 


III 


95 


146 


12 


132 


114 


. 155 


13 


41 


67 


135 


H 


19 


56 


104 


15 


7 


52 


III 


i6 


2 


37 


124 


17 


3 


44 


117 


i8 


3 


34 


88 


19 




36 


71 


20 




30 


54 


21 




26 


40 


22 




15 


28 


23 




7 


25 


24 




2 


4 


Number Tested 


906 


833 


1447 


Median 


9.744 


12.908 


14.409 


25 Percentile 


7.506 


10.843 


11.799 


75 Percentile 


I I . 824 


16.615 


17.558 


Quartile 


2.159 


2.886 


2.878 
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TABLE XXII 

Number in Each Group That Solved Each Exercise 
in Addition and Subtraction Test Correctly 



Problem Number 


Three-Month 
Group 


Six-Month 
Group 


Nine- Month 
Group 


I 


867 


819 


1425 


2 


884 


825 


1433 


3 


833 


812 


1418 


4 


846 


771 


1377 


5 


653 


735 


1316 


6 


674 


712 


1259 


7 


679 


765 


1344 


8 


560 


659 


1202 


9 


637 


680 


1246 


10 


471 


603 


1 105 


II 


393 


574 


1083 


12 


360 


524 


926 


13 


184 


454 


927 


H 


56 


384 


791 


15 


8 


185 


369 


i6 


23 


327 


670 


17 


18 


341 


681 


i8 


10 


212 


497 


19 


5 


174 


402 


20 


4 


150 


292 


21 


2 


131 


270 


22 




95 


191 


23 


I 


32 


59 


24 




II 


158 


Number Tested 


906 


833 


1447 



Tables of Crude Data 
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TABLE XXIII 
Location Above Zero of E^ch Addition and Subtraction Exercise 



Problem 


Three-Month 


Six- Month 


Nine-Month 


Final Value 


Number 


Group 


Group 


Group 


I 


1.282 


2.060 


2.032 


1.66 


2 


.902 


1. 741 


1.777 


1. 18 


3 


1-752 


2.308 


2.200 


2.06 


4 


1.592 


3.079 


2.791 


2.46 


5 


2 957 


3.456 


3.265 


3.19 


6 


2.854 


3.644 


3.581 


3.30 


7 


2.830 


3.149 


3.067 


2.97 


8 


3.381 


4.012 


3.823 


3.70 


9 


3.036 


3.878 


3.635 


3.46 


10 


3.752 


4.331 


4.177 


4.08 


II 


4.072 


4.482 


4.248 


4.27 


12 


4.213 


4.724 


4.713 


4.55 


13 


5.058 


5.045 


4.709 


4.92 


H 


6.107 


5.358 


5.069 


5.39 


15 


7.332 


6.348 


6.221 


6.41 


i6 


6.731 


5.620 


5.382 


5.74 


17 


6.870 


5.554 


5.352 


5.61 


i8 


7.221 


6.095 


5.844 


6. II 


19 


7.646 


6.414 


6. 117 


6.42 


20 


7.764 


6.570 


6.482 


6.70 


21 


8.101 


6.706 


6.562 


6.63 


22 




7.001 


6.900 


6.95 


23 


8.426 


7.927 


8.258 


8.09 


24 




8.513 


7.506 


7.76 
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TABLE XXIV 

Distribution According to the Number of Multiplication 
and Division Exercises Solved 





Three-Month 


Six-Month 


Nine-Month 




Group 


Group 


Group 





3 


I 




I 


5 






2 


6 






3 


28 




I 


4 


21 


3 


I 


5 


33 


3 


7 


6 


49 


II 


I 


7 


69 


19 


12 


8 


88 


26 


19 


9 


108 


42 


33 


10 


81 


54 


47 


II 


84 


70 


58 


12 


56 


90 


99 


13 


36 


84 


III 


H 


33 


86 


147 


15 


19 


89 


162 


l6 


9 


63 


192 


17 


8 


56 


207 


i8 


4 


49 


136 


19 




43 


118 


20 




14 


lOI 


21 




6 


37 


22 




2 


10 


23 






6 


Number Tested 


740 


811 


1505 


Median 


9.630 


14.029 


16.284 


25 Percentile 


7-579 


11.625 


13.885 


75 Percentile 


I I . 762 


16.480 


18.233 


Quartile 


2.091 


2.427 


2.174 



Tables of Crude Data 

TABLE XXV 

Number in Each Group That Solved Each Exercise 
in Multiplication or Division Test Correctly 
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Problem Number 


Three-Month 
Group 


Six-Month 
Group 


Nine-Month 
Group 


I 


724 


804 


1499 


2 


705 


796 


i486 


3 


662 


784 


1456 


4 


597 


771 


1452 


5 


674 


771 


1437 


6 


494 


716 


1385 


7 


535 


710 


1343 


8 


409 


624 


1210 


9 


503 


667 


1318 


10 


240 


467 


955 


II 


311 


521 


1053 


12 


264 


535 


1272 


13 


203 


546 


1 145 


14 


99 


497 


1257 


15 


65 


410 


1 167 


i6 


136 


377 


937 


17 


72 


200 


497 


i8 


28 


250 


727 


19 


46 


179 


529 


20 


5 


112 


361 


21 




12 


118 


22 


2 


166 


592 


23 




5 


56 


Number Tested 


740 


811 


1505 
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TABLE XXVI 
Location Above Zero of E^ch Multiplication and Division Exercise 



Problem 


Three-Month 


Six-Month 


Nine-Month 


Final Value 


Number 


Group 


Group 


Group 


I 


1.069 


2.227 


2.666 


1.45 


2 


1.584 


2.675 


3.304 


2.29 


3 


2.208 


3.026 


3.878 


2.92 


4 


2.781 


3.299 


3.918 


3.26 


5 


3.070 


3.299 


4.090 


3.42 


6 


3.427 


3.987 


4.521 


3.86 


7 


3.189 


4.046 


4.769 


3.92 


8 


3.869 


4.661 


5.335 


4.54 


9 


3.374 


4.384 


4.791 


4.10 


10 


4.744 


5.468 


6.096 


5.44 


II 


4.366 


5.213 


5.831 


5.14 


12 


4.610 


5.136 


5.098 


4.93 


13 


4.958 


5.087 


5.552 


5.16 


H 


5.710 


5.326 


5.160 


5.39 


15 


6.074 


5.730 


5.484 


5.72 


i6 


5.402 


5.882 


6.143 


5.85 


17 


5.993 


6.766 


7.256 


6.73 


i8 


6.698 


6.496 


6.667 


6.60 


19 


6.348 


6.892 


7. 171 


6.89 


20 


7.710 


7.368 


7.651 


7.54 


21 




9.000 


8.707 


8.80 


22 


8.150 


6.974 


7.003 


6.99 


23 




9.469 


9.248 


9.32 



Tables of Crude Data 
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TABLE XXVII 

Distribution According to the Number of Problems 

in Problem Test Solved 





Three-Month 


Six-Month 


Nine-Month 




Group 


Group 


Group 





I 






I 


19 


7 


6 


2 


25 


26 


18 


3 


70 


47 


69 


4 


154 


96 


122 


5 


130 


118 


161 


6 


"5 


126 


174 


7 


67 


97 


194 


8 


39 


80 


182 


9 


16 


51 


139 


10 


10 


39 


96 


II 


I 


20 


74 


12 


I 


8 


33 


13 




2 


30 


U 






7 


Number Tested 


648 


717 


1305 


Median 


5423 


6.512 


7.528 


25 Percentile 


4.305 • 


5.027 


5.691 


75 Percentile 


6.765 


8.259 


9-379 


Quartile 


1.230 


1. 616 


1.944 
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TABLE XXVIII 

Number in E^ch Group That Solved E^ch Problem 
in the Problem Test Correctly 



Problem Number 


Three-Month 
Group 


SiX'Morith 
Group 


Nine-Month 
Group 


I 


640 


712 


1301 


2 


531 


624 


1 165 


3 


579 


682 


1226 


4 


530 


597 


1144 


5 


346 


505 


949 


6 


215 


304 


728 


7 


223 


326 


666 


8 


lOI 


206 


551 


9 


40 


142 


431 


ID 


57 


121 


323 


II 


6 


126 


400 


12 


10 


83 


252 


13 


2 


9 


43 


1 H 


2 


16 


"5 


Number Tested 


648 


717 


1305 



TABLE XXIX 
Location Above Zero of E^ch Problem of the Problem Test 



Problem 


Three-Month 


Six-Month 


Nine-Month 


Final Value 


Number 


Group 


Group 


Group 


I 


.892 


1.245 


1.376 


1.07 


2 


2.868 


3.218 


3.401 


3.16 


3 


2.376 


2.435 


3. 151 


2.61 


4 


2.873 


3 456 


3.724 


3.35 


5 


4.092 


4.093 


4.549 


4.24 


6 


4.863 


5.172 


5.228 


5.09 


7 


4.815 


5.056 


5.407 


5.09 


8 


5.718 


5.722 


5.736 


5.72 


9 


6.500 


6.147 


6.096 


6.20 


10 


6.226 


6.309 


6.458 


6.36 


II 


7.790 


6.268 


6.192 


6.42 


12 


7.438 


6.660 


6.730 


6.80 


13 


8.302 


8.234 


8.170 


8.19 


14 


8.302 


7.874 


7.388 


7.58 



Tables of Cmde Data 

TABLE XXX 

Distribution According to the Number of Exercises 
in the Graph Test Solved 
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Four and One-half 


Nine-Month 




Month Group 


Group 





8 


2 


I 


27 


5 


2 


92 


10 


3 


165 


30 


4 


102 


73 


5 


47 


113 


6 


28 


122 


7 


15 


140 


8 


5 


129 


9 


3 


102 


10 


3 


38 


II 




3 


Number Tested 


495 


767 


Median 


3.730 


7.204 


25 Percentile 


2 965 


5.635 


75 Percentile 


4.777 


8.622 


Quartile 


.906 


1.494 
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TABLE XXXI 

Number in Each Group That Solved Each Exercise 
in the Graph Test Correctly 



i 
Problem Number 


Four and One-half 
Month Group 


Nine-Month 
Group 


I 


473 


755 


2 


448 


743 


3 


384 


727 


4 


240 


674 


5 


50 


211 


6 


165 


520 


7 


91 


445 


8 


10 


254 


9 


2 


434 


10 


2 


214 


II 


2 


47 


Number Tested 


495 


767 



TABLE XXXII 
Location Above Zero of Each Exercise in the Graph Test 



Problem Number 


Four*and One-half 
Month Group 


Nine-Month 
Group 


Final Value 


I 


.882 


2.473 


1. 41 


2 


1.360 


2.903 


1.98 


3 


2.179 


3.259 


2.61 


4 


3.360 


3.935 


3.61 


5 


5.196 


6.556 


5.97 


6 


3.944 


4.977 


4.46 


7 


4.639 


5.371 


5.06 


8 


6.348 


6.318 


6.32 


9 


7.242 


5.424 


5.79 


10 


7.242 


6.539 


6.68 


II 


7.242 


7 963 


7.72 



APPENDIX 

ADMINISTRATION AND USE OF FIRST YEAR 

ALGEBRA SCALES 

Standard tests used in measuring schoolroom products must be 
as simple as possible, and their use must be thoroughly understood 
by the teachers who are expected to administer them. For the 
convenience of these teachers all suggestions concerning the use 
of the algebra scales are brought together here in concise form. 
Little new material is added, and what follows is largely a rearrange- 
ment of what has preceded, with possibly an added emphasis upon 
certain essential features. 

To test a clciss in first year algebra all that is necessary is to pro- 
cure a set of the scales, follow the detailed instructions in adminis- 
tering and in scoring them, and finally determine the median class 
score by the method as shown in this section. This median score 
can then be compared with the tentative standard scores given in 
this monograph. 

TYPES OF SCALES 

Five different scales are available. These are: 

1. Addition and Subtraction Scale. 

2. Multiplication and Division Scale. 

3. Equation and Formula Scale. 

4. Graph Scale. 

5. Problem Scale. 

Two of these, it will be seen, are designed to test the achievement 
of students in the fundamental operations, two of them test the 
ability of students in handling the instruments of quantitative 
thinking, and the last is composed of typical problems in first year 
algebra. 

Two series of each scale are offered — Series A and Series B. 
Series B is the long one and contains from eleven to twenty-five 
exercises in each scale. Series A is shorter and contains from eight 
to twelve exercises in each scale. It is composed of exercises taken 
from Series B. It covers just as wide range of difficulty and has 
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the added advantage of having the intervals between successive 
exercises or problems approximately equal. 

SELECTION OF SCALES TO BE USED 

The writer feels that Series A will be found to be on the whole 
more satisfactory than Series B, especially where the time available 
for testing purposes is limited. This is particularly true if the 
purpose of the test is primarily the determination of degrees 
of attainment. If, however, the purpose of the test is mainly 
diagnostic, that is, to discover difficulties which students are en- 
countering, Series B should be used because it contains a more 
complete and richer variety of exercises. 

If only one scale can be used, the writer would recommend the 
Equation and Formula Scale, because it is more comprehensive 
and so tests a much wider function. At least two scales should be 
used, however, and the writer feels that the Problem Scale should 
come second in importance. 

WHEN TO GIVE THE SCALES 

The comparative standards derived from this study and pub- 
lished in this monograph are for three-, six-, and nine-month inter- 
vals. It is, therefore, much more satisfactory for comparative 
purposes to submit these scales to algebra classes immediately after 
they have studied algebra for three, for six, or for nine months. 

DIRECTIONS FOR GIVING SCALES 

1. PreUminary, While the test sheets are being distributed, ask 
the students to wait for full directions before they do anything at 
all with the tests. When all are ready, say to the class, "Now write 
your name in the first blank space. In the next blank space to your 
right tell how old you are. Give this in full years to your nearest 
birthday," etc. 

2. Instructions, After the sheets are properly headed, say to the 
class, "The exercises on this sheet are in addition and subtraction, 
collection of terms (multiplication and division, on the equation and 
formula, graphs, problems in algebra). Work directly on these 
sheets. Take the exercises in the order in which they are given. Work 
as many as you possibly can and be sure you get them right. If you 
come to one you cannot do, leave it out and pass on to the next." 
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In the Multiplication and Division test, call attention to the 
fact that "all answers must be reduced to their simplest forms." 

For the Graph Scale, let the students use rulers. 

For the Problem Scale add : "In all the problems which call for the 
equation, e. g., No. 4, simply state the equation which will solve 
the problem. That is, if you were given this problem: A coat and 
hat cost $30. The coat cost 5 times as much as the hat. Find the 
cost of each. The equation would be x + 5x = $30." (Then write 
this equation on the board.) 

Note. Students may be provided with scratch paper for their own use. It has 
been found to be most satisfactory to pass down the aisles and give each pupil a sheet 
of scratch paper a few minutes after the test has begun. They will find it most con- 
venient, however, to work directly on the question sheets. For all but the problem 
test it is desirable to have as much of the work as possible on these sheets. 

TIME LIMITS 

The time limits to be observed in giving the tests are as follows: 
For each test in Series A allow twenty minutes, except the Problem 
and the Graph tests, for each of which twenty-five minutes should be 
allowed. For each test in Series B, allow forty minutes. 

A warning, stating the amount of time left, should be given three 
minutes in advance for the tests of Series A, and five minutes in 
advance for those of Series B. 

SCORING RESULTS 

Problems are to be marked either right or wrong. All answers 
which may be accepted as correct are given in Tables I and II of 
this monograph.^ After the scoring is completed, it will be found 
convenient to tabulate the results of a class as shown in Fig. i. 

DIRECTIONS FOR DETERMINING CLASS SCORE 

The median class score is used in connection with these scales 
as the most satisfactory measurement of the achievement of a class. 
This median score represents the number of problems solved cor- 
rectly by just fifty per cent of a class. That is, there are just as 
many students in a class who solve a larger number as there are 
students who solve a smaller number of problems. It is very readily 
computed; and, because of the fact that an error of one-half point 
in its computation becomes quite significant when comparison is to 

* See pp. 30-36. 
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be made with the standard median scores given for the various 
scales of this study, a few sample class distributions are given below 
and their median clsiss scores computed. 

TABLE I 

Sample Distribution of Scores made by Four Different Classes in Equation 

and Formula Test 







CLASSES 




Number of 










Problems Solved 












/ 


// 


III 


IV 













I 


I 




2 




2 


2 


I 


I 


I 


3 


2 




2 


3 


■ 4 


I 




I 


2 


5 


4 


I 


2 


3 


6 


6 


5 


3 


2 


7 


3 


4 


I 




8 


3 


3 


I 


3 


9 


2 


2 


2 


4 


10 


I 


I 


I 


2 


II 


I 


I 




I 


12 










13 








I 


U 




I 






15 










Total 


26 


19 


i6 


22 



According to this table, there were twenty-six students in Class I, 
nineteen students in Class II, sixteen students in Class III, and 
twenty- two students in Class IV. In Class I one student solved 
one problem correctly, two solved two problems correctly, two 
solved three correctly, etc. To find the median score of this class, 
it is necessary to find the point in the distribution of the class where 
there are just as many students who solved a greater number of 
problems as there are students who solved a smaller number. 
Since there are twenty-six students in the class, this point is obvi- 
ously midway between the scores made by the thirteenth and 



Appendix 85 

fourteenth students, counting down in the distribution. That is, 
to include the thirteenth individual with the poorer group, it is 
necessary to count three of the six students who solved six prob- 
lems; and, since it is assumed that the individuals are distributed 
evenly through a step at equal distances from one another, the 
median point is just one-half of the distance through this step, from 
six to seven. Therefore, the median score of this class is 6.5 problems 
solved correctly. 

In Class II there are nineteen students. Thus, there are 9.5 
individuals both above and below the exact median point in the 
distribution of this class. To include 9.5 individuals with the 
poorer group, it is necessary to count 2.5 of the 4 students who 

solved 7 problems. Hence, the median point is just -^ of the 

4 
distance through the 7th step, which makes the median score of 

this class 7.6 problems solved correctly. Class III illustrates 
another situation still. There are 16 students in the class, and in 
counting out the 8 individuals for the poorer group, we exactly 
take up all the cases in the 5th step. The fact to be noticed here is 
that the median point is raised clear through the 5th step. The 
median score for this class, therefore, is 6.0 problems correctly solved. 
Class IV is here included to assist in the solution of another dif- 
ficulty which is often encountered. There are 22 individuals in the 
class. Counting from the top of the distribution, the 11 cases for 
the poorer group take us, as seen above, entirely through step 6. 
Likewise, counting from below, to include 11 cases, we have to go 
clear through step 8. From this it appears that the median point 
could be located all the way from 7 to 8 in the class distribution. 
Since, however, any given distance on a scale is best represented 
by its middle point, the median score of this class should be 7.5 
problems solved correctly. 

TENTATIVE STANDARD SCORES ^ 

As stated above, tentative standards of achievement have been 
established in all the scales for classes that have studied algebra 

'To establish more accurate standards of attainment, the writer will be pleased to 
receive the results obtained by investigators who use any one of the scales proposed 
in this monograph. Such records should be sent to Teachers College Bureau of 
Publications. 
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for three, for six, and for nine months. These standards are given 
in Tables IV and V of this monograph.' 

VALUE OF FIRST YEAR ALGEBRA SCALES 

These scales may be used by teachers for three distinct and very 
useful purposes. They may be used (a) to indicate attainment, (6) 
to measure progress, and (c) to diagnose difficulties. 

Scales which increase in difficulty by approximately equal steps 
furnish a most reliable objective means for determining the actual 
achievement of a student or a class of students. Any one of the 
scales may be used for this purpose, though the Equation and 
Formula Scale is perhaps to be preferred, since, as previously stated, 
it is a more comprehensive test. It is well to keep in mind also, in 
this connection that a low median class score is not always, nor 
even quite generally, due to poor instruction. Any one or a com- 
bination of several causes may be operating to keep a class score 
down. It is the duty of the teacher, however, to study these causes 
and to learn which ones are affecting the efficiency of the instruc- 
tion, in order that proper remedial measures may be applied. This 
it is possible to accomplish with a much greater degree of certainty 
when the teacher knows the actual standard of achievement a class 
has attained. Such knowledge furnishes the teacher with a fact 
basis upon which to proceed and a motive with which to operate. 

The extent of progress made by a class can be quite scientifically 
measured by submitting the same scale to a class at intervals of 
about three months. Teachers should be cautioned very specifi- 
cally, however, not to do any drill work upon the exercises or 
problems appearing in the scales. If it is feared that some of the 
practice effect may survive, it is suggested that another scale in 
the same series, or the same scale in a different series, be used for 
the second test. The most desirable method of measuring progress, 
very naturally, would be to have another parallel series of scales 
similar and equal in difficulty to those of Series A, and it is to be 
hoped that such a series will soon be constructed. 

For diagnostic purposes the scales of Series B have been found 
to be more serviceable. They offer a richer variety of exercises and, 
therefore, a greater number of type processes. Hence, a more com- 

» See p. 41. 
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plete analysis of the mistakes made by students, and the difficulties 
they encounter, is made possible. 

Finally, it must be stated emphatically that these are primarily 
power tests and as such should never be used for purposes of drill. 
Furthermore, with the time limits as now fixed, they are speed tests 
to a limited extent only. If a pure speed test is desired, the Stan- 
dard Tests* devised by Dr. H. O. Rugg could be used to advantage. 
These would be particularly useful in determining whether a class 
has had sufficient drill upon the fundamentals. 

^ School Review, October, 191 7, 25:546. 
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